Sep 08 18:54:35 devstack cinder-volume[76119]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 18:54:35 devstack cinder-volume[76119]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 18:54:35 devstack cinder-volume[76119]: we strongly recommend against using it for new projects. Sep 08 18:54:35 devstack cinder-volume[76119]: If you are already using Eventlet, we recommend migrating to a different Sep 08 18:54:35 devstack cinder-volume[76119]: framework. For more detail see Sep 08 18:54:35 devstack cinder-volume[76119]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 18:54:35 devstack cinder-volume[76119]: import eventlet # noqa Sep 08 18:54:38 devstack cinder-volume[76119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 18:54:38 devstack cinder-volume[76119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 18:54:38 devstack cinder-volume[76119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 18:54:39 devstack cinder-volume[76119]: INFO dbcounter [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Registered counter for database cinder Sep 08 18:54:39 devstack cinder-volume[76119]: DEBUG oslo_db.sqlalchemy.engines [None req-d7064645-b827-4e59-82c0-058963a93831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:54:39 devstack cinder-volume[76119]: DEBUG dbcounter [-] [76119] Writer thread running {{(pid=76119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 18:54:39 devstack cinder-volume[76119]: INFO cinder.rpc [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 18:54:39 devstack cinder-volume[76119]: INFO cinder.rpc [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_db.sqlalchemy.engines [None req-d7064645-b827-4e59-82c0-058963a93831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:54:40 devstack cinder-volume[76119]: INFO cinder.volume.manager [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Determined volume DB was empty at startup. Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG cinder.volume.manager [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76119) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 18:54:40 devstack cinder-volume[76119]: INFO cinder.volume.manager [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 18:54:40 devstack cinder-volume[76119]: WARNING stevedore.named [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 18:54:40 devstack cinder-volume[76119]: WARNING castellan.key_manager [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 18:54:40 devstack cinder-volume[76119]: WARNING cinder.keymgr.conf_key_mgr [None req-d7064645-b827-4e59-82c0-058963a93831 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG cinder.volume.drivers.lvm [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76119) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_concurrency.processutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_concurrency.processutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] CMD "cinder-rtstool verify" returned: 0 in 0.413s {{(pid=76119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_db.sqlalchemy.engines [None req-d7064645-b827-4e59-82c0-058963a93831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:54:40 devstack cinder-volume[76119]: INFO cinder.rpc [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 08 18:54:40 devstack cinder-volume[76119]: INFO cinder.rpc [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 08 18:54:40 devstack cinder-volume[76119]: WARNING stevedore.named [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 18:54:40 devstack cinder-volume[76119]: WARNING castellan.key_manager [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 18:54:40 devstack cinder-volume[76119]: INFO cinder.volume.manager [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_db.sqlalchemy.engines [None req-d7064645-b827-4e59-82c0-058963a93831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:54:40 devstack cinder-volume[76119]: INFO oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Starting 1 workers Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Started child 76275 {{(pid=76119) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Full set of CONF: {{(pid=76119) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] ******************************************************************************** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Configuration options gathered from: {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] ================================================================================ {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] allow_availability_zone_fallback = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76275]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] allow_compression_on_image_upload = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] allowed_direct_url_schemes = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] api_rate_limit = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] auth_strategy = keystone {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] az_cache_duration = 3600 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_availability_zone = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_host = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_stats_polling_interval = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backup_api_class = cinder.backup.api.API {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backup_name_template = backup-%s {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backup_use_same_host = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backup_use_temp_snapshot = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] chap_password = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] chap_username = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_internal_tenant_project_id = c064a402d7434a86bf7f7889cd619069 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_internal_tenant_user_id = 588c96b6c8cd43ef9dd7f2d5a8439940 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cloned_volume_same_az = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cluster = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] compression_format = gzip {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] compute_api_class = cinder.compute.nova.API {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] config_dir = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] config_source = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] control_exchange = openstack {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] debug = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] default_availability_zone = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] default_group_type = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] default_volume_type = lvmdriver-1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] disk_geometry = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] driver_client_cert = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] driver_client_cert_key = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] driver_data_namespace = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] driver_ssl_cert_path = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] driver_ssl_cert_verify = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] driver_use_ssl = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] enable_force_upload = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] enable_new_services = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] enable_unsupported_driver = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] enforce_multipath_for_image_xfer = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] filter_function = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_api_insecure = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_api_ssl_compression = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_ca_certificates_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_catalog_info = image:glance:publicURL {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_num_retries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance_request_timeout = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] goodness_function = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] graceful_shutdown_timeout = 5 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] group_api_class = cinder.group.api.API {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] host = devstack {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_compress_on_upload = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_conversion_address_space_limit = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_conversion_cpu_limit = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_conversion_disable = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_upload_use_cinder_backend = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_upload_use_internal_tenant = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_volume_cache_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_volume_cache_max_count = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] image_volume_cache_max_size_gb = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] init_host_max_objects_retrieval = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] instance_format = [instance: %(uuid)s] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] iscsi_target_flags = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] iscsi_write_cache = on {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] iser_helper = tgtadm {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] iser_ip_address = 192.168.122.253 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] iser_port = 3260 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_color = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_config_append = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_dir = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_options = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_rotate_interval = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_rotate_interval_type = days {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] log_rotation_type = none {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] max_age = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] max_logfile_count = 30 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] max_logfile_size_mb = 200 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 08 18:54:40 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] max_over_subscription_ratio = 20.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] message_reap_interval = 86400 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] message_ttl = 2592000 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] migration_create_volume_timeout_secs = 300 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] monkey_patch = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] monkey_patch_modules = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] my_ip = 192.168.122.253 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] no_snapshot_gb_quota = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] num_iser_scan_tries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] num_shell_tries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] num_volume_device_scan_tries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] nvmeof_conn_info_version = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] nvmet_ns_id = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] nvmet_port_id = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] osapi_max_limit = 1000 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] osapi_volume_ext_list = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] osapi_volume_listen_port = 8776 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] osapi_volume_use_ssl = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] osapi_volume_workers = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] per_volume_size_limit = -1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] periodic_fuzzy_delay = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] periodic_interval = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] public_endpoint = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] publish_errors = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] quota_backup_gigabytes = 1000 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] quota_backups = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] quota_gigabytes = 1000 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] quota_groups = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] quota_snapshots = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] quota_volumes = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] rate_limit_burst = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] rate_limit_except_level = CRITICAL {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] rate_limit_interval = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] reinit_driver_count = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] replication_device = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] report_discard_supported = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] report_interval = 120 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] reservation_clean_interval = 86400 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] reservation_expire = 86400 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] reserved_image_namespaces = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] reserved_percentage = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] rpc_response_timeout = 120 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] run_external_periodic_tasks = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] scst_target_driver = iscsi {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] scst_target_iqn_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_down_time = 720 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] shell_completion = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] snapshot_name_template = snapshot-%s {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] snapshot_same_host = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] split_loggers = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] state_path = /opt/stack/data/cinder {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] storage_availability_zone = nova {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] storage_protocol = iSCSI {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] syslog_log_facility = LOG_USER {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] target_helper = lioadm {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] target_ip_address = 192.168.122.253 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] target_port = 3260 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] target_protocol = iscsi {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] target_secondary_ip_addresses = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] trace_flags = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] transport_url = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] until_refresh = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] use_chap_auth = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] use_default_quota_class = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] use_journal = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] use_json = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] use_multipath_for_image_xfer = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] use_stderr = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] use_syslog = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] verify_glance_signatures = enabled {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_api_class = cinder.volume.api.API {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_backend_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_clear = zero {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_clear_ionice = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_clear_size = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_copy_bps_limit = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_dd_blocksize = 1M {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_name_template = volume-%s {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_service_inithost_offload = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volume_usage_audit_period = month {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] zoning_mode = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_concurrency.disable_process_locking = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.auth_section = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.auth_type = password {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.auth_version = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.cache = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.include_service_catalog = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.insecure = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.interface = public {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_password = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcache_username = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.region_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.service_type = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.backend = dogpile.cache.null {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.backend_argument = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.backend_expiration_time = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.config_prefix = cache.oslo {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.debug_cache_backend = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.enable_retry_client = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.enable_socket_keepalive = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.expiration_time = 600 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.hashclient_retry_attempts = 2 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.memcache_dead_retry = 300 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.memcache_pool_maxsize = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.memcache_sasl_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.password = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.proxies = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.redis_db = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.redis_server = localhost:6379 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.retry_attempts = 2 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.retry_delay = 0.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.socket_keepalive_count = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.socket_keepalive_idle = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.socket_keepalive_interval = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.socket_timeout = 1.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.tls_allowed_ciphers = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.tls_cafile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.tls_certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.tls_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.tls_keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cache.username = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] coordination.backend_url = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.asyncio_connection = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.asyncio_slave_connection = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.backend = sqlalchemy {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.connection = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.connection_debug = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.connection_parameters = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.connection_recycle_time = 3600 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.connection_trace = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.db_inc_retry_interval = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.db_max_retries = 20 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.db_max_retry_interval = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.db_retry_interval = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.max_overflow = 50 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.max_pool_size = 5 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.max_retries = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.mysql_wsrep_sync_wait = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.pool_timeout = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.retry_interval = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.slave_connection = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.sqlite_synchronous = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.synchronous_reader = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] database.use_db_reconnect = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:40 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_tracing.insecure = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.connection_string = messaging:// {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.es_doc_type = notification {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.es_scroll_size = 10000 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.es_scroll_time = 2m {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.filter_error_trace = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.hmac_keys = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.sentinel_service_name = mymaster {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.socket_timeout = 0.1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.trace_requests = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler.trace_sqlalchemy = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler_jaeger.process_tags = {} {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler_jaeger.service_name_prefix = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] profiler_otlp.service_name_prefix = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.enforce_new_defaults = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.policy_default_rule = default {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.policy_file = policy.yaml {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack sudo[76279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] privsep_osbrick.group = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] privsep_osbrick.helper_command = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] privsep_osbrick.user = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_sys_admin.group = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_sys_admin.helper_command = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] cinder_sys_admin.user = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.auth_section = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.auth_type = password {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.cafile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.collect_timing = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.insecure = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.send_service_user_token = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.split_loggers = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.timeout = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.tls_ciphers = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] service_user.tls_min_version = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.auth_section = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.auth_type = password {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.collect_timing = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.insecure = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.region_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.split_loggers = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.timeout = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.tls_ciphers = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] glance.tls_min_version = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.backend_availability_zone = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.chap_password = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.chap_username = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.disk_geometry = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.driver_client_cert = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.driver_client_cert_key = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.driver_data_namespace = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.driver_use_ssl = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.extra_capabilities = {} {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.filter_function = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.goodness_function = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.iscsi_target_flags = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.iscsi_write_cache = on {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.iser_helper = tgtadm {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.iser_port = 3260 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.lvm_share_target = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.lvm_type = auto {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.num_shell_tries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.replication_device = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.report_discard_supported = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.reserved_percentage = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.target_helper = tgtadm {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.target_port = 3260 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.target_protocol = iscsi {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.trace_flags = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.unique_fqdn_network = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.use_chap_auth = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_backend_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_clear = zero {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_clear_ionice = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_clear_size = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_reports.file_event_handler = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_reports.log_dir = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.backend_host = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.chap_password = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.chap_username = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.disk_geometry = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.driver_client_cert = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.extra_capabilities = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.filter_function = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.goodness_function = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.iser_helper = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.iser_ip_address = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.iser_port = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.lvm_share_target = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.lvm_type = auto {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.num_shell_tries = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.replication_device = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.report_discard_supported = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.reserved_percentage = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.scst_target_driver = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.storage_protocol = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.target_helper = lioadm {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.target_ip_address = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.target_port = 3260 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.trace_flags = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.use_chap_auth = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_clear = zero {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_clear_size = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] lvmdriver-1.volumes_dir = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.ssl = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_notifications.driver = [] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_notifications.retry = -1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] key_manager.fixed_key = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.barbican_api_version = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.barbican_endpoint = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.barbican_endpoint_type = public {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.barbican_region_name = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.cafile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.collect_timing = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.insecure = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.number_of_retries = 60 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.retry_delay = 1 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.send_service_user_token = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.split_loggers = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.timeout = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.tls_ciphers = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.tls_min_version = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.verify_ssl = True {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican.verify_ssl_path = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.auth_section = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.auth_type = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.cafile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.certfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.collect_timing = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.insecure = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.keyfile = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.split_loggers = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.timeout = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.tls_ciphers = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] barbican_service_user.tls_min_version = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.approle_role_id = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.approle_secret_id = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.auth_method = approle {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.auth_path = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.kv_mountpoint = secret {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.kv_path = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.kv_version = 2 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.namespace = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.root_token_id = **** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.ssl_ca_crt_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.timeout = 60.0 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.token_file = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.token_role = None {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.use_ssl = False {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:54:41 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] ******************************************************************************** {{(pid=76119) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 18:54:41 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:41 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:41 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:41 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:41 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:41 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:41 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.352s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:41 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 18:54:41 devstack cinder-volume[76275]: INFO cinder.brick.local_dev.lvm [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 08 18:54:41 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:41 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:41 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:41 devstack sudo[76492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:54:41 devstack sudo[76492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:42 devstack sudo[76492]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG cinder.brick.local_dev.lvm [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76275) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:42 devstack sudo[76600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:42 devstack sudo[76600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:42 devstack sudo[76600]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:42 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:42 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:42 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:42 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:43 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 08 18:54:43 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:43 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.245s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:43 devstack sudo[76930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:54:43 devstack sudo[76930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:43 devstack sudo[76930]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:43 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:54:43 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:43 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:43 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:43 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:54:43 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:44 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:44 devstack sudo[77103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:44 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:44 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:44 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:44 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:44 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:44 devstack cinder-volume[76275]: INFO cinder.volume.drivers.lvm [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:44 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:44 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:44 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:45 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:45 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:54:45 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:45 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:45 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:54:45 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:45 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:45 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:45 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:45 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:45 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:45 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:54:45 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:46 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:46 devstack cinder-volume[76275]: INFO cinder.volume.driver [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG cinder.volume.driver [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76275) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG oslo_db.sqlalchemy.engines [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76275) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writer thread running {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG cinder.db.api [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Building query based on filter {{(pid=76275) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG cinder.image.image_utils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76275) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 18:54:46 devstack cinder-volume[76275]: INFO cinder.keymgr.migration [None req-71ded294-a0f5-4b4b-adca-2bb833538f6c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:46 devstack sudo[77136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:54:46 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:46 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:46 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:54:46 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:46 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:46 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:46 devstack sudo[77145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:46 devstack sudo[77145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:47 devstack sudo[77145]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:47 devstack sudo[77148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:54:47 devstack sudo[77148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:47 devstack sudo[77148]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:54:47 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Driver initialization completed successfully. Sep 08 18:54:47 devstack cinder-volume[76275]: INFO cinder.manager [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Initiating service 2 cleanup Sep 08 18:54:47 devstack cinder-volume[76275]: INFO cinder.manager [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Service 2 cleanup completed. Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG cinder.service [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Creating RPC server for service cinder-volume {{(pid=76275) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG cinder.service [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76275) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 18:54:47 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:47 devstack sudo[77151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:54:47 devstack sudo[77151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:47 devstack sudo[77151]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:47 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:47 devstack sudo[77156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:54:47 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:48 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:48 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:48 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:48 devstack sudo[77159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:54:48 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:48 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:48 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:48 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:54:48 devstack sudo[77162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:54:48 devstack sudo[77162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:54:48 devstack sudo[77162]: pam_unix(sudo:session): session closed for user root Sep 08 18:54:48 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:54:48 devstack cinder-volume[76275]: INFO cinder.volume.manager [None req-b9fc92c5-4306-4573-81d7-2e41b451c370 None None] Driver post RPC initialization completed successfully. Sep 08 18:54:50 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:54:50 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 18:54:50 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread info: [<_MainThread(MainThread, started 128943442026624)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 18:54:50 devstack cinder-volume[76119]: DEBUG dbcounter [-] [76119] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:54:58 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:54:58 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:55:50 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:55:50 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 18:55:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:55:50 devstack sudo[79612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:55:50 devstack sudo[79612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:55:50 devstack sudo[79612]: pam_unix(sudo:session): session closed for user root Sep 08 18:55:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:55:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:55:50 devstack sudo[79615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:55:50 devstack sudo[79615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:55:51 devstack sudo[79615]: pam_unix(sudo:session): session closed for user root Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:55:51 devstack sudo[79618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:55:51 devstack sudo[79618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:55:51 devstack sudo[79618]: pam_unix(sudo:session): session closed for user root Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:55:51 devstack sudo[79621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:55:51 devstack sudo[79621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:55:51 devstack sudo[79621]: pam_unix(sudo:session): session closed for user root Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 18:55:51 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread info: [<_MainThread(MainThread, started 128943442026624)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 18:56:50 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:56:50 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 18:56:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:56:50 devstack sudo[82993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:56:50 devstack sudo[82993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:56:50 devstack sudo[82993]: pam_unix(sudo:session): session closed for user root Sep 08 18:56:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:56:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:56:50 devstack sudo[82997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:56:50 devstack sudo[82997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:56:51 devstack sudo[82997]: pam_unix(sudo:session): session closed for user root Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:56:51 devstack sudo[83001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:56:51 devstack sudo[83001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:56:51 devstack sudo[83001]: pam_unix(sudo:session): session closed for user root Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:56:51 devstack sudo[83008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:56:51 devstack sudo[83008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:56:51 devstack sudo[83008]: pam_unix(sudo:session): session closed for user root Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 18:56:51 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread info: [<_MainThread(MainThread, started 128943442026624)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 18:56:58 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:57:50 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:57:50 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 18:57:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:57:50 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:57:50 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:57:50 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Sep 08 18:57:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:57:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:57:50 devstack sudo[85023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:57:50 devstack sudo[85023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:57:51 devstack sudo[85023]: pam_unix(sudo:session): session closed for user root Sep 08 18:57:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:57:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:57:51 devstack sudo[85028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:57:51 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:57:51 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root Sep 08 18:57:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:57:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:57:51 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:57:51 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:57:51 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Sep 08 18:57:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:57:51 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:58:50 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:58:50 devstack cinder-volume[76275]: DEBUG cinder.volume.drivers.lvm [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Updating volume stats {{(pid=76275) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 18:58:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:58:50 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 18:58:50 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:58:50 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Sep 08 18:58:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:58:50 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:58:50 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:58:50 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:58:51 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:58:51 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 18:58:51 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:58:51 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:58:51 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 18:58:51 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:58:51 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG oslo_concurrency.processutils [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76275) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG cinder.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Notifying Schedulers of capabilities ... {{(pid=76275) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG oslo_service.periodic_task [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] Running periodic task VolumeManager._thread_info {{(pid=76275) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread count: 6 {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 18:58:51 devstack cinder-volume[76275]: DEBUG cinder.volume.manager [None req-e5307a36-d7d3-49a7-acb3-2a2dd4dffc0d None None] thread info: [<_MainThread(MainThread, started 128943442026624)>, , , , , ] {{(pid=76275) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 18:58:58 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:SELECT=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:58:58 devstack cinder-volume[76275]: DEBUG dbcounter [-] [76275] Writing DB stats cinder:UPDATE=1 {{(pid=76275) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:59:02 devstack cinder-volume[76119]: INFO oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Caught SIGTERM, stopping children Sep 08 18:59:02 devstack cinder-volume[76119]: DEBUG oslo_concurrency.lockutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Acquiring lock "singleton_lock" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 18:59:02 devstack cinder-volume[76119]: DEBUG oslo_concurrency.lockutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Acquired lock "singleton_lock" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 18:59:02 devstack cinder-volume[76119]: DEBUG oslo_concurrency.lockutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Releasing lock "singleton_lock" {{(pid=76119) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 18:59:02 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Stop services. {{(pid=76119) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 18:59:02 devstack cinder-volume[76119]: DEBUG oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Killing children. {{(pid=76119) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 18:59:02 devstack cinder-volume[76119]: INFO oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Waiting on 1 children to exit Sep 08 18:59:02 devstack cinder-volume[76275]: DEBUG oslo_concurrency.lockutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Acquiring lock "singleton_lock" {{(pid=76275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 18:59:02 devstack cinder-volume[76275]: DEBUG oslo_concurrency.lockutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Acquired lock "singleton_lock" {{(pid=76275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 18:59:02 devstack cinder-volume[76275]: DEBUG oslo_concurrency.lockutils [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Releasing lock "singleton_lock" {{(pid=76275) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 18:59:02 devstack cinder-volume[76275]: WARNING amqp [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 18:59:02 devstack cinder-volume[76275]: WARNING amqp [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 18:59:02 devstack cinder-volume[76119]: INFO oslo_service.backend._eventlet.service [None req-d7064645-b827-4e59-82c0-058963a93831 None None] Child 76275 exited with status 0 Sep 08 18:59:02 devstack cinder-volume[86718]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 18:59:02 devstack cinder-volume[86718]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 18:59:02 devstack cinder-volume[86718]: we strongly recommend against using it for new projects. Sep 08 18:59:02 devstack cinder-volume[86718]: If you are already using Eventlet, we recommend migrating to a different Sep 08 18:59:02 devstack cinder-volume[86718]: framework. For more detail see Sep 08 18:59:02 devstack cinder-volume[86718]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 18:59:02 devstack cinder-volume[86718]: import eventlet # noqa Sep 08 18:59:05 devstack cinder-volume[86718]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 18:59:05 devstack cinder-volume[86718]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 18:59:05 devstack cinder-volume[86718]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 18:59:05 devstack cinder-volume[86718]: INFO dbcounter [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Registered counter for database cinder Sep 08 18:59:05 devstack cinder-volume[86718]: DEBUG oslo_db.sqlalchemy.engines [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86718) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG dbcounter [-] [86718] Writer thread running {{(pid=86718) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 18:59:06 devstack cinder-volume[86718]: INFO cinder.rpc [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 18:59:06 devstack cinder-volume[86718]: INFO cinder.rpc [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_db.sqlalchemy.engines [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86718) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:06 devstack cinder-volume[86718]: INFO cinder.volume.manager [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Determined volume DB was empty at startup. Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG cinder.volume.manager [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86718) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 18:59:06 devstack cinder-volume[86718]: INFO cinder.volume.manager [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 18:59:06 devstack cinder-volume[86718]: WARNING stevedore.named [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 18:59:06 devstack cinder-volume[86718]: WARNING castellan.key_manager [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 18:59:06 devstack cinder-volume[86718]: WARNING cinder.keymgr.conf_key_mgr [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 18:59:06 devstack cinder-volume[86718]: INFO cinder.volume.manager [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_db.sqlalchemy.engines [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86718) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:06 devstack cinder-volume[86718]: INFO oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Starting 1 workers Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Started child 86938 {{(pid=86718) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Full set of CONF: {{(pid=86718) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] ******************************************************************************** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Configuration options gathered from: {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 18:59:06 devstack cinder-volume[86938]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] ================================================================================ {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] allow_availability_zone_fallback = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] allow_compression_on_image_upload = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] allowed_direct_url_schemes = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] api_rate_limit = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] auth_strategy = keystone {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_availability_zone = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_host = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_stats_polling_interval = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backup_api_class = cinder.backup.api.API {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backup_name_template = backup-%s {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backup_use_same_host = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backup_use_temp_snapshot = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] chap_password = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] chap_username = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_internal_tenant_project_id = c064a402d7434a86bf7f7889cd619069 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_internal_tenant_user_id = 588c96b6c8cd43ef9dd7f2d5a8439940 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cluster = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] compression_format = gzip {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] compute_api_class = cinder.compute.nova.API {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] config_dir = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] config_source = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] control_exchange = openstack {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] debug = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] default_availability_zone = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] default_group_type = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] default_volume_type = QuobyteHD {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] disk_geometry = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] driver_client_cert = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] driver_client_cert_key = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] driver_data_namespace = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] driver_ssl_cert_path = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] driver_ssl_cert_verify = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] driver_use_ssl = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] enable_new_services = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86938]: INFO cinder.volume.manager [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.remotefs [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86938) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] enable_unsupported_driver = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] enabled_backends = ['QuobyteHD'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] enforce_multipath_for_image_xfer = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] filter_function = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_api_insecure = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_api_ssl_compression = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_ca_certificates_file = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_catalog_info = image:glance:publicURL {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_num_retries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance_request_timeout = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] goodness_function = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] graceful_shutdown_timeout = 5 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] group_api_class = cinder.group.api.API {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] host = devstack {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_compress_on_upload = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_conversion_address_space_limit = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_conversion_cpu_limit = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_conversion_disable = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_upload_use_cinder_backend = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_upload_use_internal_tenant = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_volume_cache_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_volume_cache_max_count = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] image_volume_cache_max_size_gb = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] init_host_max_objects_retrieval = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] instance_format = [instance: %(uuid)s] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] iscsi_target_flags = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] iscsi_write_cache = on {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] iser_helper = tgtadm {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] iser_ip_address = 192.168.122.253 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] iser_port = 3260 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_color = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_config_append = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_dir = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_file = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_options = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_rotate_interval = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_rotate_interval_type = days {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] log_rotation_type = none {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] max_age = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] max_logfile_count = 30 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] max_logfile_size_mb = 200 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] max_over_subscription_ratio = 20.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] message_reap_interval = 86400 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] message_ttl = 2592000 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] migration_create_volume_timeout_secs = 300 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] monkey_patch = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] monkey_patch_modules = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] my_ip = 192.168.122.253 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] no_snapshot_gb_quota = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] num_iser_scan_tries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] num_shell_tries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] num_volume_device_scan_tries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] nvmeof_conn_info_version = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] nvmet_ns_id = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] nvmet_port_id = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] osapi_max_limit = 1000 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] osapi_volume_ext_list = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] osapi_volume_listen_port = 8776 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] osapi_volume_use_ssl = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] osapi_volume_workers = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] per_volume_size_limit = -1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] periodic_fuzzy_delay = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] periodic_interval = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] public_endpoint = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] publish_errors = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] quota_backup_gigabytes = 1000 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] quota_backups = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] quota_gigabytes = 1000 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] quota_groups = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] quota_snapshots = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] quota_volumes = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] rate_limit_burst = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86938) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] rate_limit_except_level = CRITICAL {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] rate_limit_interval = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] reinit_driver_count = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] replication_device = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] report_discard_supported = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86938]: WARNING cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] report_interval = 120 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86938]: WARNING cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] reservation_clean_interval = 86400 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] reservation_expire = 86400 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] reserved_image_namespaces = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] reserved_percentage = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Running cmd (subprocess): mount.quobyte {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] rpc_response_timeout = 120 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] run_external_periodic_tasks = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] scst_target_driver = iscsi {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] scst_target_iqn_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_down_time = 720 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] shell_completion = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] snapshot_name_template = snapshot-%s {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] split_loggers = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] state_path = /opt/stack/data/cinder {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] storage_availability_zone = nova {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] storage_protocol = iSCSI {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] syslog_log_facility = LOG_USER {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] target_helper = lioadm {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] target_ip_address = 192.168.122.253 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] target_port = 3260 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] target_protocol = iscsi {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] target_secondary_ip_addresses = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] trace_flags = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] transport_url = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] until_refresh = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] use_chap_auth = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] use_default_quota_class = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] use_journal = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] use_json = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] use_multipath_for_image_xfer = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] use_stderr = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] use_syslog = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] verify_glance_signatures = enabled {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_api_class = cinder.volume.api.API {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_backend_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_clear = zero {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_clear_ionice = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_clear_size = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_copy_bps_limit = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_dd_blocksize = 1M {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_name_template = volume-%s {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_service_inithost_offload = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volume_usage_audit_period = month {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] zoning_mode = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_concurrency.disable_process_locking = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.auth_section = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.auth_type = password {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.auth_version = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.cache = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.include_service_catalog = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.insecure = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.interface = public {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_password = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcache_username = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.region_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.service_type = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.backend = dogpile.cache.null {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.backend_argument = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.backend_expiration_time = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.config_prefix = cache.oslo {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.debug_cache_backend = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.enable_retry_client = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.enable_socket_keepalive = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.expiration_time = 600 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.hashclient_retry_attempts = 2 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.memcache_dead_retry = 300 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.memcache_pool_maxsize = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack quobyte-client[86939]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.memcache_sasl_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.password = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.proxies = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.redis_db = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack quobyte-client[86939]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.redis_server = localhost:6379 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.retry_attempts = 2 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.retry_delay = 0.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.socket_keepalive_count = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.socket_keepalive_idle = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.socket_keepalive_interval = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.socket_timeout = 1.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.tls_allowed_ciphers = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.tls_cafile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.tls_certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.tls_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.tls_keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cache.username = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] coordination.backend_url = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.asyncio_connection = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.asyncio_slave_connection = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.backend = sqlalchemy {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.connection = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.connection_debug = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=86938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.connection_parameters = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86938]: INFO cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a ... Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.connection_recycle_time = 3600 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 -c /etc/quobyte/client-cinder.cfg {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.connection_trace = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.db_inc_retry_interval = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.db_max_retries = 20 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.db_max_retry_interval = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.db_retry_interval = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.max_overflow = 50 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.max_pool_size = 5 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.max_retries = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.mysql_wsrep_sync_wait = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.pool_timeout = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.retry_interval = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.slave_connection = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.sqlite_synchronous = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.synchronous_reader = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] database.use_db_reconnect = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_tracing.insecure = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.connection_string = messaging:// {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.es_doc_type = notification {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.es_scroll_size = 10000 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.es_scroll_time = 2m {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.filter_error_trace = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.hmac_keys = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 -c /etc/quobyte/client-cinder.cfg Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.sentinel_service_name = mymaster {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.socket_timeout = 0.1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.trace_requests = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler.trace_sqlalchemy = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler_jaeger.process_tags = {} {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler_jaeger.service_name_prefix = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] profiler_otlp.service_name_prefix = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.enforce_new_defaults = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.policy_default_rule = default {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.policy_file = policy.yaml {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] privsep_osbrick.group = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] privsep_osbrick.helper_command = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] privsep_osbrick.user = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_sys_admin.group = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_sys_admin.helper_command = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] cinder_sys_admin.user = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.auth_section = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.auth_type = password {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.cafile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.collect_timing = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.insecure = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.send_service_user_token = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.split_loggers = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.timeout = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.tls_ciphers = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] service_user.tls_min_version = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.auth_section = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.auth_type = password {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.collect_timing = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.insecure = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.region_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.split_loggers = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.timeout = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.tls_ciphers = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] glance.tls_min_version = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.backend_availability_zone = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.chap_password = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.chap_username = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.disk_geometry = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.driver_client_cert = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.driver_client_cert_key = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.driver_data_namespace = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.driver_use_ssl = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.extra_capabilities = {} {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.filter_function = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.goodness_function = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.iscsi_target_flags = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.iscsi_write_cache = on {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.iser_helper = tgtadm {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.iser_port = 3260 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_host = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_login = admin {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_mount_options = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_password = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_private_key = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_share_path = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.num_shell_tries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.quobyte_volume_url = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.replication_device = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.report_discard_supported = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.reserved_percentage = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.target_helper = tgtadm {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.target_port = 3260 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.target_protocol = iscsi {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.trace_flags = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.unique_fqdn_network = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.use_chap_auth = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_backend_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_clear = zero {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_clear_ionice = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_clear_size = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_reports.file_event_handler = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_reports.log_dir = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.backend_availability_zone = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.backend_host = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.chap_password = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.chap_username = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.chiscsi_conf = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.disk_geometry = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.driver_client_cert = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.driver_data_namespace = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.driver_use_ssl = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.extra_capabilities = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.filter_function = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.goodness_function = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.iser_helper = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.iser_ip_address = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.iser_port = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.iser_target_prefix = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_host = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_login = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_mount_options = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_password = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_private_key = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_share_path = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_ssh_port = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.num_shell_tries = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.nvmet_port_id = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.replication_device = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.report_discard_supported = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.reserved_percentage = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.scst_target_driver = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.storage_protocol = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.target_helper = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.target_ip_address = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.target_port = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.target_prefix = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.target_protocol = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.trace_flags = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.use_chap_auth = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_clear = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_clear_size = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] QuobyteHD.volumes_dir = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.ssl = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_notifications.driver = [] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_notifications.retry = -1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] key_manager.fixed_key = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.barbican_api_version = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.barbican_endpoint = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.barbican_endpoint_type = public {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.barbican_region_name = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.cafile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.collect_timing = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.insecure = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.number_of_retries = 60 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.retry_delay = 1 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.send_service_user_token = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.split_loggers = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.timeout = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.tls_ciphers = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.tls_min_version = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.verify_ssl = True {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican.verify_ssl_path = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.auth_section = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.auth_type = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.cafile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.certfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.collect_timing = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.insecure = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.keyfile = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.split_loggers = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.timeout = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.tls_ciphers = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] barbican_service_user.tls_min_version = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.approle_role_id = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.approle_secret_id = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.auth_method = approle {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.auth_path = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.kv_mountpoint = secret {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.kv_path = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.kv_version = 2 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.namespace = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.root_token_id = **** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.ssl_ca_crt_file = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.timeout = 60.0 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.token_file = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.token_role = None {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.use_ssl = False {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:06 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] ******************************************************************************** {{(pid=86718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 18:59:07 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.410s {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:07 devstack cinder-volume[86938]: INFO cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a succeeded Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=86938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.420s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:07 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 18:59:07 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:07 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.229s {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:07 devstack cinder-volume[86938]: INFO cinder.volume.driver [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.volume.driver [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4696960449219, 'free_capacity_gb': 1773.4696960449219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86938) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_db.sqlalchemy.engines [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86938) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG dbcounter [-] [86938] Writer thread running {{(pid=86938) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.db.api [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Building query based on filter {{(pid=86938) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.image.image_utils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86938) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 18:59:07 devstack cinder-volume[86938]: INFO cinder.keymgr.migration [None req-767a7119-7f61-4873-86c4-bcb3d348f1ad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=86938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=86938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:07 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 18:59:07 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:07 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.241s {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.manager [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Notifying Schedulers of capabilities ... {{(pid=86938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:59:07 devstack cinder-volume[86938]: INFO cinder.volume.manager [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Driver initialization completed successfully. Sep 08 18:59:07 devstack cinder-volume[86938]: INFO cinder.manager [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Initiating service 3 cleanup Sep 08 18:59:07 devstack cinder-volume[86938]: INFO cinder.manager [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Service 3 cleanup completed. Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.service [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Creating RPC server for service cinder-volume {{(pid=86938) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.service [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86938) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 18:59:07 devstack cinder-volume[86938]: INFO cinder.volume.manager [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=86938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=86938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 18:59:07 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:07 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 18:59:07 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:08 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:08 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.257s {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:08 devstack cinder-volume[86938]: INFO cinder.volume.manager [None req-5915b9aa-2441-4a29-9807-c832e24de002 None None] Driver post RPC initialization completed successfully. Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=86938) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG cinder.volume.drivers.quobyte [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=86938) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86938) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:12 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 18:59:12 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:12 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG oslo_concurrency.processutils [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.217s {{(pid=86938) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:12 devstack cinder-volume[86938]: DEBUG cinder.manager [None req-bce0b90a-3db0-4c70-b3db-c239f5d1d8ba None None] Notifying Schedulers of capabilities ... {{(pid=86938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:59:15 devstack cinder-volume[86718]: INFO oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Caught SIGTERM, stopping children Sep 08 18:59:15 devstack cinder-volume[86718]: DEBUG oslo_concurrency.lockutils [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Acquiring lock "singleton_lock" {{(pid=86718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 18:59:15 devstack cinder-volume[86718]: DEBUG oslo_concurrency.lockutils [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Acquired lock "singleton_lock" {{(pid=86718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 18:59:15 devstack cinder-volume[86718]: DEBUG oslo_concurrency.lockutils [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Releasing lock "singleton_lock" {{(pid=86718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 18:59:15 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Stop services. {{(pid=86718) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 18:59:15 devstack cinder-volume[86718]: DEBUG oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Killing children. {{(pid=86718) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 18:59:15 devstack cinder-volume[86718]: INFO oslo_service.backend._eventlet.service [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Waiting on 1 children to exit Sep 08 18:59:17 devstack cinder-volume[86938]: DEBUG dbcounter [-] [86938] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86938) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:59:18 devstack cinder-volume[86938]: DEBUG dbcounter [-] [86938] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86938) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:59:20 devstack cinder-volume[86938]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 08 18:59:21 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Acquiring lock "singleton_lock" {{(pid=86938) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 18:59:21 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Acquired lock "singleton_lock" {{(pid=86938) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 18:59:21 devstack cinder-volume[86938]: DEBUG oslo_concurrency.lockutils [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Releasing lock "singleton_lock" {{(pid=86938) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 18:59:21 devstack cinder-volume[86938]: WARNING amqp [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 18:59:21 devstack cinder-volume[86938]: WARNING amqp [None req-079d0767-39ca-48c9-ba16-6cf2ab1c6757 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 18:59:21 devstack cinder-volume[87246]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 18:59:21 devstack cinder-volume[87246]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 18:59:21 devstack cinder-volume[87246]: we strongly recommend against using it for new projects. Sep 08 18:59:21 devstack cinder-volume[87246]: If you are already using Eventlet, we recommend migrating to a different Sep 08 18:59:21 devstack cinder-volume[87246]: framework. For more detail see Sep 08 18:59:21 devstack cinder-volume[87246]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 18:59:21 devstack cinder-volume[87246]: import eventlet # noqa Sep 08 18:59:23 devstack cinder-volume[87246]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 18:59:23 devstack cinder-volume[87246]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 18:59:23 devstack cinder-volume[87246]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87246) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 18:59:24 devstack cinder-volume[87246]: INFO dbcounter [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Registered counter for database cinder Sep 08 18:59:24 devstack cinder-volume[87246]: DEBUG oslo_db.sqlalchemy.engines [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87246) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:24 devstack cinder-volume[87246]: DEBUG dbcounter [-] [87246] Writer thread running {{(pid=87246) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 18:59:24 devstack cinder-volume[87246]: INFO cinder.rpc [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 18:59:24 devstack cinder-volume[87246]: INFO cinder.rpc [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 18:59:24 devstack cinder-volume[87246]: DEBUG oslo_db.sqlalchemy.engines [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87246) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:24 devstack cinder-volume[87246]: INFO cinder.volume.manager [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Determined volume DB was empty at startup. Sep 08 18:59:24 devstack cinder-volume[87246]: DEBUG cinder.volume.manager [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87246) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 18:59:24 devstack cinder-volume[87246]: WARNING stevedore.named [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 18:59:24 devstack cinder-volume[87246]: WARNING castellan.key_manager [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 18:59:24 devstack cinder-volume[87246]: WARNING cinder.keymgr.conf_key_mgr [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 18:59:24 devstack cinder-volume[87246]: INFO cinder.volume.manager [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_db.sqlalchemy.engines [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87246) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:25 devstack cinder-volume[87246]: INFO oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Starting 1 workers Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Started child 87538 {{(pid=87246) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Full set of CONF: {{(pid=87246) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] ******************************************************************************** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] Configuration options gathered from: {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] ================================================================================ {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] allow_availability_zone_fallback = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] allow_compression_on_image_upload = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] allowed_direct_url_schemes = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] api_rate_limit = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87538]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] auth_strategy = keystone {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_availability_zone = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_host = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_stats_polling_interval = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backup_api_class = cinder.backup.api.API {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backup_name_template = backup-%s {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backup_use_same_host = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backup_use_temp_snapshot = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] chap_password = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] chap_username = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_internal_tenant_project_id = c064a402d7434a86bf7f7889cd619069 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_internal_tenant_user_id = 588c96b6c8cd43ef9dd7f2d5a8439940 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cluster = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] compression_format = gzip {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] compute_api_class = cinder.compute.nova.API {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] config_dir = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] config_source = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] control_exchange = openstack {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] debug = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] default_availability_zone = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] default_group_type = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] default_volume_type = QuobyteHD {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] disk_geometry = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] driver_client_cert = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] driver_client_cert_key = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] driver_data_namespace = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] driver_ssl_cert_path = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] driver_ssl_cert_verify = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] driver_use_ssl = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] enable_new_services = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] enable_unsupported_driver = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] enabled_backends = ['QuobyteHD'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] enforce_multipath_for_image_xfer = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] filter_function = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_api_insecure = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_api_ssl_compression = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_ca_certificates_file = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_catalog_info = image:glance:publicURL {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_num_retries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance_request_timeout = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] goodness_function = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] graceful_shutdown_timeout = 5 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] group_api_class = cinder.group.api.API {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] host = devstack {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_compress_on_upload = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_conversion_address_space_limit = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_conversion_cpu_limit = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_conversion_disable = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_upload_use_cinder_backend = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_upload_use_internal_tenant = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_volume_cache_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_volume_cache_max_count = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] image_volume_cache_max_size_gb = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] init_host_max_objects_retrieval = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] instance_format = [instance: %(uuid)s] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] iscsi_target_flags = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] iscsi_write_cache = on {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] iser_helper = tgtadm {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] iser_ip_address = 192.168.122.253 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] iser_port = 3260 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_color = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_config_append = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_dir = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_file = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_options = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_rotate_interval = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_rotate_interval_type = days {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] log_rotation_type = none {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] max_age = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] max_logfile_count = 30 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] max_logfile_size_mb = 200 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] max_over_subscription_ratio = 20.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] message_reap_interval = 86400 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] message_ttl = 2592000 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] migration_create_volume_timeout_secs = 300 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] monkey_patch = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] monkey_patch_modules = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87538) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] my_ip = 192.168.122.253 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] no_snapshot_gb_quota = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] num_iser_scan_tries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] num_shell_tries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] num_volume_device_scan_tries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] nvmeof_conn_info_version = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] nvmet_ns_id = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] nvmet_port_id = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] osapi_max_limit = 1000 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] osapi_volume_ext_list = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] osapi_volume_listen = 0.0.0.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] osapi_volume_listen_port = 8776 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] osapi_volume_use_ssl = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] osapi_volume_workers = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] per_volume_size_limit = -1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] periodic_fuzzy_delay = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] periodic_interval = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] project_id_regex = [0-9a-f\-]+ {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] public_endpoint = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] publish_errors = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] quota_backup_gigabytes = 1000 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] quota_backups = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] quota_gigabytes = 1000 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] quota_groups = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] quota_snapshots = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] quota_volumes = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] rate_limit_burst = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] rate_limit_except_level = CRITICAL {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] rate_limit_interval = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] reinit_driver_count = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] replication_device = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] report_discard_supported = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] report_interval = 120 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] reservation_clean_interval = 86400 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] reservation_expire = 86400 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] reserved_image_namespaces = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] reserved_percentage = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] rpc_response_timeout = 120 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] run_external_periodic_tasks = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] scst_target_driver = iscsi {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] scst_target_iqn_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_down_time = 720 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] shell_completion = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] snapshot_name_template = snapshot-%s {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] split_loggers = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] state_path = /opt/stack/data/cinder {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] storage_availability_zone = nova {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] storage_protocol = iSCSI {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] syslog_log_facility = LOG_USER {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] target_helper = lioadm {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] target_ip_address = 192.168.122.253 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] target_port = 3260 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] target_protocol = iscsi {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] target_secondary_ip_addresses = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] trace_flags = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] transfer_api_class = cinder.transfer.api.API {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] transport_url = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] until_refresh = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] use_chap_auth = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] use_default_quota_class = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] use_journal = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] use_json = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] use_multipath_for_image_xfer = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] use_stderr = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] use_syslog = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] verify_glance_signatures = enabled {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_api_class = cinder.volume.api.API {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_backend_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_clear = zero {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_clear_ionice = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_clear_size = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_copy_bps_limit = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_dd_blocksize = 1M {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_name_template = volume-%s {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_service_inithost_offload = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volume_usage_audit_period = month {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] zoning_mode = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_concurrency.disable_process_locking = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.auth_section = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.auth_type = password {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.auth_version = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.cache = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.delay_auth_decision = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.http_connect_timeout = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.include_service_catalog = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.insecure = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.interface = public {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_password = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcache_username = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.region_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.service_token_roles_required = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.service_type = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.token_cache_time = 300 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.backend = dogpile.cache.null {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.backend_argument = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.backend_expiration_time = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.config_prefix = cache.oslo {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.debug_cache_backend = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.enable_retry_client = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.enable_socket_keepalive = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.expiration_time = 600 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.hashclient_retry_attempts = 2 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.memcache_dead_retry = 300 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.memcache_pool_maxsize = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.memcache_sasl_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.password = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.proxies = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.redis_db = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.redis_sentinel_service_name = mymaster {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.redis_server = localhost:6379 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.retry_attempts = 2 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.retry_delay = 0.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.socket_keepalive_count = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.socket_keepalive_idle = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.socket_keepalive_interval = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.socket_timeout = 1.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.tls_allowed_ciphers = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.tls_cafile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.tls_certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.tls_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.tls_keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cache.username = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] coordination.backend_url = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.asyncio_connection = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.asyncio_slave_connection = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.backend = sqlalchemy {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.connection = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.connection_debug = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.connection_parameters = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.connection_recycle_time = 3600 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.connection_trace = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.db_inc_retry_interval = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.db_max_retries = 20 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.db_max_retry_interval = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.db_retry_interval = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.max_overflow = 50 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.max_pool_size = 5 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.max_retries = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.mysql_wsrep_sync_wait = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.pool_timeout = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.retry_interval = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.slave_connection = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.sqlite_synchronous = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.synchronous_reader = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] database.use_db_reconnect = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_tracing.insecure = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.connection_string = messaging:// {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.es_doc_type = notification {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.es_scroll_size = 10000 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.es_scroll_time = 2m {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.filter_error_trace = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.hmac_keys = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.sentinel_service_name = mymaster {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.socket_timeout = 0.1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87538) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.trace_requests = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler.trace_sqlalchemy = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler_jaeger.process_tags = {} {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler_jaeger.service_name_prefix = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] profiler_otlp.service_name_prefix = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.enforce_new_defaults = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.policy_default_rule = default {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.policy_file = policy.yaml {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_policy.remote_timeout = 60.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] privsep_osbrick.group = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] privsep_osbrick.helper_command = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] privsep_osbrick.user = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_sys_admin.group = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_sys_admin.helper_command = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] cinder_sys_admin.user = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.auth_section = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.auth_type = password {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.cafile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.collect_timing = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.insecure = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.send_service_user_token = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.split_loggers = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.timeout = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.tls_ciphers = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] service_user.tls_min_version = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.auth_section = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.auth_type = password {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.collect_timing = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.insecure = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.region_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.split_loggers = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.timeout = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.tls_ciphers = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] glance.tls_min_version = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.backend_availability_zone = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.chap_password = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.chap_username = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.disk_geometry = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.driver_client_cert = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.driver_client_cert_key = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.driver_data_namespace = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.driver_use_ssl = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.enable_unsupported_driver = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.extra_capabilities = {} {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.filter_function = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.goodness_function = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.iscsi_target_flags = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.iscsi_write_cache = on {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.iser_helper = tgtadm {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.iser_port = 3260 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_host = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_login = admin {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_mount_options = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_password = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_private_key = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_share_path = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_ssh_port = 22 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.num_shell_tries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.nvmet_port_id = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.quobyte_client_cfg = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.quobyte_volume_url = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.replication_device = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.report_discard_supported = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.reserved_percentage = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.scst_target_driver = iscsi {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.scst_target_iqn_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.storage_protocol = iSCSI {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.target_helper = tgtadm {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.target_port = 3260 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.target_protocol = iscsi {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.trace_flags = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.unique_fqdn_network = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.use_chap_auth = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_backend_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_clear = zero {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_clear_ionice = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_clear_size = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_reports.file_event_handler = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_reports.log_dir = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.backend_availability_zone = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.backend_host = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.chap_password = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.chap_username = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.chiscsi_conf = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.disk_geometry = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.driver_client_cert = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.driver_client_cert_key = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.driver_data_namespace = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.driver_use_ssl = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.extra_capabilities = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.filter_function = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.goodness_function = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.iscsi_target_flags = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.iscsi_write_cache = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.iser_helper = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.iser_ip_address = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.iser_port = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.iser_target_prefix = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_host = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_login = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_mount_options = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_password = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_private_key = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_share_path = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_ssh_port = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.num_shell_tries = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack quobyte-client[87539]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nvmet_ns_id = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.nvmet_port_id = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack quobyte-client[87539]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.replication_device = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.report_discard_supported = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.reserved_percentage = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.scst_target_driver = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.storage_protocol = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.target_helper = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.target_ip_address = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.target_port = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.target_prefix = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.target_protocol = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.trace_flags = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.unique_fqdn_network = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.use_chap_auth = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_clear = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_clear_ionice = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_clear_size = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] QuobyteHD.volumes_dir = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.ssl = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.ssl_version = {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_notifications.driver = [] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_notifications.retry = -1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] oslo_messaging_notifications.transport_url = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] key_manager.fixed_key = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.barbican_api_version = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.barbican_endpoint = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.barbican_endpoint_type = public {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.barbican_region_name = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.cafile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.collect_timing = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.insecure = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.number_of_retries = 60 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.retry_delay = 1 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.send_service_user_token = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.split_loggers = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.timeout = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.tls_ciphers = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.tls_min_version = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.verify_ssl = True {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican.verify_ssl_path = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.auth_section = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.auth_type = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.cafile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.certfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.collect_timing = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.insecure = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.keyfile = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.split_loggers = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.timeout = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.tls_ciphers = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] barbican_service_user.tls_min_version = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.approle_role_id = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.approle_secret_id = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.auth_method = approle {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.auth_path = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.kv_mountpoint = secret {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.kv_path = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.kv_version = 2 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.namespace = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.root_token_id = **** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.ssl_ca_crt_file = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.timeout = 60.0 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.token_file = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.token_role = None {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.use_ssl = False {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 18:59:25 devstack cinder-volume[87246]: DEBUG oslo_service.backend._eventlet.service [None req-e140c764-c73e-4a7e-8516-b1deaf5e1eed None None] ******************************************************************************** {{(pid=87246) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 18:59:25 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 18:59:25 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:25 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:25 devstack cinder-volume[87538]: INFO cinder.volume.driver [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.volume.driver [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4696960449219, 'free_capacity_gb': 1773.4696960449219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87538) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_db.sqlalchemy.engines [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writer thread running {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.db.api [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Building query based on filter {{(pid=87538) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87538) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:25 devstack cinder-volume[87538]: INFO cinder.keymgr.migration [None req-49760462-893b-42cf-a574-8af774333684 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 18:59:25 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 18:59:25 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:25 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.235s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 18:59:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Driver initialization completed successfully. Sep 08 18:59:25 devstack cinder-volume[87538]: INFO cinder.manager [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Initiating service 3 cleanup Sep 08 18:59:25 devstack cinder-volume[87538]: INFO cinder.manager [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Service 3 cleanup completed. Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.service [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Creating RPC server for service cinder-volume {{(pid=87538) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 18:59:25 devstack cinder-volume[87538]: DEBUG cinder.service [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87538) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 18:59:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 18:59:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 18:59:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 18:59:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 18:59:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 18:59:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 18:59:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 18:59:26 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 18:59:26 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 18:59:26 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Sep 08 18:59:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.246s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 18:59:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-02ac628b-fc4e-4234-a5ea-d58212c4a6c3 None None] Driver post RPC initialization completed successfully. Sep 08 18:59:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 18:59:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 6 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 18:59:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 18:59:35 devstack cinder-volume[87246]: DEBUG dbcounter [-] [87246] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87246) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:59:35 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=2 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 18:59:36 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Flow 'volume_create_manager' (fc59574a-3175-4e9c-8506-cfb4c5f14734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a20b898-a00b-45c4-a5d7-f4703eb03e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a20b898-a00b-45c4-a5d7-f4703eb03e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-56908113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fa1799-eba1-46fe-b3a4-9713edffcf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5884bfae302429b8b0ed4424df255bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:00:24Z,use_quota=True,user_id='84ac132cff0f4604a3ef07bcafec1069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8cfdb-9563-4916-97ee-55f0e74f42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b8cfdb-9563-4916-97ee-55f0e74f42bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9591a3e3-1675-4b5d-9da1-4b1b0e29981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9591a3e3-1675-4b5d-9da1-4b1b0e29981a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7fa1799-eba1-46fe-b3a4-9713edffcf4f', 'volume_name': 'volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83f119-2164-45d3-91a3-af5a73dd6234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d83f119-2164-45d3-91a3-af5a73dd6234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b01f85-dd92-401b-ad44-d5649d88d350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:23 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Volume b7fa1799-eba1-46fe-b3a4-9713edffcf4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f', 'volume_size': 1} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-56908113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fa1799-eba1-46fe-b3a4-9713edffcf4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5884bfae302429b8b0ed4424df255bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:00:24Z,use_quota=True,user_id='84ac132cff0f4604a3ef07bcafec1069',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Creating volume b7fa1799-eba1-46fe-b3a4-9713edffcf4f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:00:23 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:00:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:23 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f 1073741824 Sep 08 19:00:23 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:24 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f 1073741824" returned: 0 in 0.722s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:24 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f Sep 08 19:00:24 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:24 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f" returned: 0 in 0.248s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b01f85-dd92-401b-ad44-d5649d88d350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5139c950-a7c5-4e6c-b976-8caa331a7405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:24 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Volume volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f (b7fa1799-eba1-46fe-b3a4-9713edffcf4f): created successfully Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5139c950-a7c5-4e6c-b976-8caa331a7405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Flow 'volume_create_manager' (fc59574a-3175-4e9c-8506-cfb4c5f14734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:00:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5e335061-4f7b-47ff-9067-e2a5db14f032 tempest-TaggedAttachmentsTest-1172765676 None] Created volume successfully. Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:34 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:00:34 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:34 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.320s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 6 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:00:34 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Flow 'volume_create_manager' (b626861d-aa0d-4174-ba76-e7ce0150a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fb0f35-05b0-4756-807f-abc2adeecbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60fb0f35-05b0-4756-807f-abc2adeecbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-663000721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f06c440cc7c43a9b5ac2edff6b4be4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:00:47Z,use_quota=True,user_id='57ff6f46489f4893b67bf2507d1a23ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bebe33-398d-49a6-92c3-9b774ac25007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bebe33-398d-49a6-92c3-9b774ac25007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30efe0a3-f0b9-4456-9975-85e6e66cceae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30efe0a3-f0b9-4456-9975-85e6e66cceae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e', 'volume_name': 'volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb645c55-0796-4a89-880e-4ba505f4fc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb645c55-0796-4a89-880e-4ba505f4fc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c702496-cc82-4eb4-8eef-8ba005ca3ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:47 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Volume 5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e', 'volume_size': 1} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-663000721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f06c440cc7c43a9b5ac2edff6b4be4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:00:47Z,use_quota=True,user_id='57ff6f46489f4893b67bf2507d1a23ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Creating volume 5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:00:47 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:00:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:48 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e 1073741824 Sep 08 19:00:48 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:49 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e 1073741824" returned: 0 in 1.200s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:49 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e Sep 08 19:00:49 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:49 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e" returned: 0 in 0.615s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c702496-cc82-4eb4-8eef-8ba005ca3ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39681b30-1af1-472a-9626-6ebdb5ea3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Volume volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e (5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e): created successfully Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39681b30-1af1-472a-9626-6ebdb5ea3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Flow 'volume_create_manager' (b626861d-aa0d-4174-ba76-e7ce0150a261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:00:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4affbc63-eaf0-47d3-a66d-c7893d57e9b7 tempest-DeleteServersTestJSON-1394938403 None] Created volume successfully. Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Flow 'volume_create_manager' (905c97cf-f4a1-4485-9534-c1dab1528c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9db2be-4687-47b9-8bbd-0cbd762e3c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9db2be-4687-47b9-8bbd-0cbd762e3c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-508883591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392ccd3c-6a6c-4108-9f05-171a91348a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9044c22368ce4772aa59d8a4a861bd44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:00:53Z,use_quota=True,user_id='a694ce890eef4d0894dd1f75a6663c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de2e27d-ac58-48b2-8720-c652eed0732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de2e27d-ac58-48b2-8720-c652eed0732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47759665-06ec-40d3-a9db-f56ceac3959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47759665-06ec-40d3-a9db-f56ceac3959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392ccd3c-6a6c-4108-9f05-171a91348a8e', 'volume_name': 'volume-392ccd3c-6a6c-4108-9f05-171a91348a8e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19b47b1-180e-487e-9d12-4f18c5656d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19b47b1-180e-487e-9d12-4f18c5656d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9f2377-9ca6-45d6-a667-5ce67170a04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Volume 392ccd3c-6a6c-4108-9f05-171a91348a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392ccd3c-6a6c-4108-9f05-171a91348a8e', 'volume_size': 1} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-508883591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392ccd3c-6a6c-4108-9f05-171a91348a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9044c22368ce4772aa59d8a4a861bd44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:00:53Z,use_quota=True,user_id='a694ce890eef4d0894dd1f75a6663c30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Creating volume 392ccd3c-6a6c-4108-9f05-171a91348a8e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:00:53 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:00:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:53 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e 1073741824 Sep 08 19:00:53 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:54 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e 1073741824" returned: 0 in 0.868s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:00:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:54 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e Sep 08 19:00:54 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:54 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e" returned: 0 in 0.504s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:00:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:00:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9f2377-9ca6-45d6-a667-5ce67170a04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392ccd3c-6a6c-4108-9f05-171a91348a8e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f379ee2e-180e-4657-9d52-bbe3d4860bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:00:55 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Volume volume-392ccd3c-6a6c-4108-9f05-171a91348a8e (392ccd3c-6a6c-4108-9f05-171a91348a8e): created successfully Sep 08 19:00:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f379ee2e-180e-4657-9d52-bbe3d4860bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:00:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Flow 'volume_create_manager' (905c97cf-f4a1-4485-9534-c1dab1528c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:00:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5224c694-c390-4562-acde-dae751a96fb6 tempest-VolumesAdminNegativeTest-1733056587 None] Created volume successfully. Sep 08 19:00:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Acquiring lock "cinder-392ccd3c-6a6c-4108-9f05-171a91348a8e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:00:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "cinder-392ccd3c-6a6c-4108-9f05-171a91348a8e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:00:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Acquiring lock "cinder-quobyte-392ccd3c-6a6c-4108-9f05-171a91348a8e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:00:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "cinder-quobyte-392ccd3c-6a6c-4108-9f05-171a91348a8e" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:00:56 devstack cinder-volume[87538]: INFO oslo.privsep.daemon [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5_5h0fkp/privsep.sock'] Sep 08 19:00:56 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5_5h0fkp/privsep.sock Sep 08 19:00:56 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:00:57 devstack cinder-volume[87538]: WARNING py.warnings [req-3e164bb6-527c-493c-ba16-29f7c788446c req-315465db-30f7-4eba-8c29-2617f2daa15d tempest-DeleteServersTestJSON-1394938403 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 08 19:00:57 devstack cinder-volume[87538]: .first() Sep 08 19:00:57 devstack cinder-volume[87538]: Sep 08 19:00:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3e164bb6-527c-493c-ba16-29f7c788446c req-315465db-30f7-4eba-8c29-2617f2daa15d tempest-DeleteServersTestJSON-1394938403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:00:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3e164bb6-527c-493c-ba16-29f7c788446c req-315465db-30f7-4eba-8c29-2617f2daa15d tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:00:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3e164bb6-527c-493c-ba16-29f7c788446c req-315465db-30f7-4eba-8c29-2617f2daa15d tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:00:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-3e164bb6-527c-493c-ba16-29f7c788446c req-315465db-30f7-4eba-8c29-2617f2daa15d tempest-DeleteServersTestJSON-1394938403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0f40627-95dd-4eb7-ae70-071092c87f2c', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:00:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-3e164bb6-527c-493c-ba16-29f7c788446c req-315465db-30f7-4eba-8c29-2617f2daa15d tempest-DeleteServersTestJSON-1394938403 None] attachment_update completed successfully. Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 19:00:59 devstack cinder-volume[87538]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 08 19:00:59 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Sep 08 19:00:59 devstack cinder-volume[87538]: INFO oslo.privsep.daemon [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Spawned new privsep daemon via rootwrap Sep 08 19:00:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Accepted privsep connection to /tmp/tmp5_5h0fkp/privsep.sock {{(pid=87538) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 08 19:00:59 devstack cinder-volume[87538]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 08 19:00:59 devstack cinder-volume[87538]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 08 19:00:59 devstack cinder-volume[87538]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 08 19:00:59 devstack cinder-volume[87538]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88787 Sep 08 19:00:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e80c6-63d0-4747-b09c-fc76609a6dfd]: (2,) {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:00:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[723913c2-36b8-4a34-8c05-6cec4dea8505]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:00:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:00:59 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e Sep 08 19:00:59 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:00 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e" returned: 0 in 0.958s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:00 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e Sep 08 19:01:00 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:00 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-392ccd3c-6a6c-4108-9f05-171a91348a8e" returned: 0 in 0.562s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "cinder-quobyte-392ccd3c-6a6c-4108-9f05-171a91348a8e" released by "delete_volume" :: held 4.572s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:01:01 devstack cinder-volume[87538]: WARNING cinder.quota [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:01:01 devstack cinder-volume[87538]: WARNING cinder.quota [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Created reservations ['28f69b69-3723-492d-a103-38bdcb279b26', '8f3d8b61-aeb1-47d3-8119-55504b5aee13', '363c42f6-9cc6-40ce-bcf9-7b32cf967d3a', '85f08dda-a222-4fec-94f6-37942426d8e7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:01 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:01:01 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:01 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.561s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:01 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:01:01 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Deleted volume successfully. Sep 08 19:01:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bc09005e-c6c1-492e-b1a9-766358d414b0 tempest-VolumesAdminNegativeTest-1733056587 None] Lock "cinder-392ccd3c-6a6c-4108-9f05-171a91348a8e-delete_volume" released by "delete_volume" :: held 5.680s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:01:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-bdefc6cb-c6e4-45c0-adaa-a88853da7e6d req-ee64963a-7e64-41d6-ba19-97ee8cf3dcd5 tempest-DeleteServersTestJSON-1394938403 None] Terminate volume connection completed successfully. Sep 08 19:01:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-bdefc6cb-c6e4-45c0-adaa-a88853da7e6d req-ee64963a-7e64-41d6-ba19-97ee8cf3dcd5 tempest-DeleteServersTestJSON-1394938403 None] Deleting attachment a0f40627-95dd-4eb7-ae70-071092c87f2c. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Acquiring lock "cinder-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Lock "cinder-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Acquiring lock "cinder-quobyte-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Lock "cinder-quobyte-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48da43f-60a9-4c68-91bd-8a1097f15cea]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:08 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e Sep 08 19:01:08 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:08 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e" returned: 0 in 0.545s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:08 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e Sep 08 19:01:08 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:09 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e" returned: 0 in 0.388s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Lock "cinder-quobyte-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e" released by "delete_volume" :: held 0.992s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Created reservations ['42fc3841-fb13-4fb6-8525-b6e36b1d468d', 'a1c4a4e9-152f-4522-b653-1d29ba6af4d4', 'a4ec8d42-5e01-4e2f-baa0-acf936058cd6', '9fc34c51-0791-4b1f-961e-c473c8c7fb50'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:09 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:01:09 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:09 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.283s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:01:09 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Deleted volume successfully. Sep 08 19:01:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ab82dd66-c5fa-4acd-81fc-8dbd8c94f495 tempest-DeleteServersTestJSON-1394938403 None] Lock "cinder-5ef8b6b2-d2c3-49ef-990e-36fe0f47e65e-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:01:19 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=20,cinder:INSERT=4,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:01:19 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=24,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:34 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:01:34 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:34 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.298s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 8 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:01:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:01:36 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:01:36 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:01:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-0731d67e-72a2-4679-a36b-abd2b9aab246 req-92719446-a893-4cdc-ad2b-3cfefe599d0e tempest-TaggedAttachmentsTest-1172765676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:01:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-0731d67e-72a2-4679-a36b-abd2b9aab246 req-92719446-a893-4cdc-ad2b-3cfefe599d0e tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:01:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-0731d67e-72a2-4679-a36b-abd2b9aab246 req-92719446-a893-4cdc-ad2b-3cfefe599d0e tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:01:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-0731d67e-72a2-4679-a36b-abd2b9aab246 req-92719446-a893-4cdc-ad2b-3cfefe599d0e tempest-TaggedAttachmentsTest-1172765676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7756456-ba24-4c50-8f04-409446571442', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:01:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-0731d67e-72a2-4679-a36b-abd2b9aab246 req-92719446-a893-4cdc-ad2b-3cfefe599d0e tempest-TaggedAttachmentsTest-1172765676 None] attachment_update completed successfully. Sep 08 19:01:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-be16366c-38c1-4642-a6f6-ee7b6a38d64a req-194a9186-bdc8-432c-a6b9-0bdf1259818a tempest-TaggedAttachmentsTest-1172765676 None] Terminate volume connection completed successfully. Sep 08 19:01:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-be16366c-38c1-4642-a6f6-ee7b6a38d64a req-194a9186-bdc8-432c-a6b9-0bdf1259818a tempest-TaggedAttachmentsTest-1172765676 None] Deleting attachment e7756456-ba24-4c50-8f04-409446571442. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Flow 'volume_create_manager' (1aca141a-6c69-4a6a-93c1-a722f40bb2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b17bff-c4d4-4573-878a-f42c516fa82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b17bff-c4d4-4573-878a-f42c516fa82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-614063392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e956e5c-abae-4c37-96ff-a0855fa1c431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667fdef8ea21445fbcf900761934d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:01:52Z,use_quota=True,user_id='d1f73175424c45e8acc5085d7a8ba1ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2dcf4d-f2e3-44ab-b46c-4435d3a2b3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2dcf4d-f2e3-44ab-b46c-4435d3a2b3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26f6dd9-328c-4c70-87b8-315a117956ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26f6dd9-328c-4c70-87b8-315a117956ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e956e5c-abae-4c37-96ff-a0855fa1c431', 'volume_name': 'volume-6e956e5c-abae-4c37-96ff-a0855fa1c431', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51dfa71-90cd-4693-b473-e24c28daadc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51dfa71-90cd-4693-b473-e24c28daadc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4f1fa3-cc7b-4710-b204-670b658f65ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:01:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Volume 6e956e5c-abae-4c37-96ff-a0855fa1c431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e956e5c-abae-4c37-96ff-a0855fa1c431', 'volume_size': 1} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-614063392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e956e5c-abae-4c37-96ff-a0855fa1c431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667fdef8ea21445fbcf900761934d852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:01:52Z,use_quota=True,user_id='d1f73175424c45e8acc5085d7a8ba1ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Creating volume 6e956e5c-abae-4c37-96ff-a0855fa1c431 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:01:52 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:01:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:52 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 1073741824 Sep 08 19:01:52 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:54 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 1073741824" returned: 0 in 1.459s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:01:54 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 Sep 08 19:01:54 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:01:54 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Sep 08 19:01:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431" returned: 0 in 0.660s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:01:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:01:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:01:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4f1fa3-cc7b-4710-b204-670b658f65ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e956e5c-abae-4c37-96ff-a0855fa1c431', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:01:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af16e7d-d75c-4d3b-8424-7048c5757f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:01:55 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Volume volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 (6e956e5c-abae-4c37-96ff-a0855fa1c431): created successfully Sep 08 19:01:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af16e7d-d75c-4d3b-8424-7048c5757f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:01:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Flow 'volume_create_manager' (1aca141a-6c69-4a6a-93c1-a722f40bb2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:01:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bdb76810-669d-4b62-80b3-118635a17f32 tempest-ServerRescueNegativeTestJSON-1286994889 None] Created volume successfully. Sep 08 19:02:05 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:02:05 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Acquiring lock "cinder-6e956e5c-abae-4c37-96ff-a0855fa1c431-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "cinder-6e956e5c-abae-4c37-96ff-a0855fa1c431-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Acquiring lock "cinder-quobyte-6e956e5c-abae-4c37-96ff-a0855fa1c431" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "cinder-quobyte-6e956e5c-abae-4c37-96ff-a0855fa1c431" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a37ab-1418-4dde-992c-4f766e556f1f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:17 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 Sep 08 19:02:17 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Acquiring lock "cinder-b7fa1799-eba1-46fe-b3a4-9713edffcf4f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Lock "cinder-b7fa1799-eba1-46fe-b3a4-9713edffcf4f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Acquiring lock "cinder-quobyte-b7fa1799-eba1-46fe-b3a4-9713edffcf4f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Lock "cinder-quobyte-b7fa1799-eba1-46fe-b3a4-9713edffcf4f" acquired by "delete_volume" :: waited 0.050s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:18 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431" returned: 0 in 0.555s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26bcfd7-6fd4-4cdc-badf-5afee86a441f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:18 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431 Sep 08 19:02:18 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:18 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f Sep 08 19:02:18 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:18 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6e956e5c-abae-4c37-96ff-a0855fa1c431" returned: 0 in 0.538s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "cinder-quobyte-6e956e5c-abae-4c37-96ff-a0855fa1c431" released by "delete_volume" :: held 1.198s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:18 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Created reservations ['77965827-48ab-4006-9c2c-99cb81f3f0e0', 'f253034c-851a-4da3-9513-32b2bdfbee27', 'fef0b340-3e22-4810-a581-a2ee58fa8902', 'f041937d-1f21-4b0f-a070-8796b28c3280'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:19 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f" returned: 0 in 1.017s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:19 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:02:19 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:19 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f Sep 08 19:02:19 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:19 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b7fa1799-eba1-46fe-b3a4-9713edffcf4f" returned: 0 in 0.561s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Lock "cinder-quobyte-b7fa1799-eba1-46fe-b3a4-9713edffcf4f" released by "delete_volume" :: held 1.721s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Created reservations ['df088f31-fee4-4df8-8146-d5563275d7cd', '68727e50-04fb-4bdd-9117-ba547198379a', 'c0d6c021-c86d-4506-ae41-e7edb8b658e4', 'c87c550a-5968-49f0-ad61-1c1e4f838258'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:02:20 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 1.011s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:02:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Deleted volume successfully. Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8883d80b-c0c7-49ac-a61a-17f249401b90 tempest-ServerRescueNegativeTestJSON-1286994889 None] Lock "cinder-6e956e5c-abae-4c37-96ff-a0855fa1c431-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:20 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:02:20 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:21 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.996s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:21 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:02:21 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Deleted volume successfully. Sep 08 19:02:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b8bb9bd7-1d92-4a2c-b273-62509eee9672 tempest-TaggedAttachmentsTest-1172765676 None] Lock "cinder-b7fa1799-eba1-46fe-b3a4-9713edffcf4f-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:30 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=17 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:02:31 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:02:32 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:02:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Flow 'volume_create_manager' (3e17dd99-82f4-4794-ae71-6bebe512a109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadc0df1-69ee-4d3e-839b-7685f2955853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadc0df1-69ee-4d3e-839b-7685f2955853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-690427305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fdca42-0b12-4f82-8baf-315d8a5cfc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5c2bec28764130bb0568c0506c9102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:33Z,use_quota=True,user_id='83d58ccebfc242a29ab4b61bf52b771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd76beeb-0974-4d74-8b81-fc33227b5d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd76beeb-0974-4d74-8b81-fc33227b5d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1aa1c6c-df89-4f68-b8f1-dc48cff6d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1aa1c6c-df89-4f68-b8f1-dc48cff6d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4fdca42-0b12-4f82-8baf-315d8a5cfc2e', 'volume_name': 'volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3d5be-deff-4df5-b305-b6f30366e2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e3d5be-deff-4df5-b305-b6f30366e2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552e1ec4-461c-4bb8-b315-e40019badb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:33 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Volume f4fdca42-0b12-4f82-8baf-315d8a5cfc2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e', 'volume_size': 1} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-690427305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fdca42-0b12-4f82-8baf-315d8a5cfc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5c2bec28764130bb0568c0506c9102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:33Z,use_quota=True,user_id='83d58ccebfc242a29ab4b61bf52b771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Creating volume f4fdca42-0b12-4f82-8baf-315d8a5cfc2e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:02:33 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:33 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e 1073741824 Sep 08 19:02:33 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:33 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e 1073741824" returned: 0 in 0.716s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:33 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e Sep 08 19:02:33 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:34 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e" returned: 0 in 0.360s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552e1ec4-461c-4bb8-b315-e40019badb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8c9293-2307-4bfe-87c9-2b0753f7506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Volume volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e (f4fdca42-0b12-4f82-8baf-315d8a5cfc2e): created successfully Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8c9293-2307-4bfe-87c9-2b0753f7506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Flow 'volume_create_manager' (3e17dd99-82f4-4794-ae71-6bebe512a109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-13f5f95e-deae-4b0d-9ccf-9052c21bc2d3 tempest-ServersNegativeTestJSON-1368051075 None] Created volume successfully. Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:34 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:02:34 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:34 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.311s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Flow 'volume_create_manager' (50b07b10-747d-48d9-9119-09e697626b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3aea23-619a-414f-bd8b-6c8182cba697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3aea23-619a-414f-bd8b-6c8182cba697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-769162285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426b5b7e-c3c9-4216-864b-52cbe8f9d413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5c2bec28764130bb0568c0506c9102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:40Z,use_quota=True,user_id='83d58ccebfc242a29ab4b61bf52b771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8dacab-bbeb-4033-8a8f-898e02a96306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8dacab-bbeb-4033-8a8f-898e02a96306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04dd703-a4ae-4855-ae4f-2f2379542a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04dd703-a4ae-4855-ae4f-2f2379542a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426b5b7e-c3c9-4216-864b-52cbe8f9d413', 'volume_name': 'volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f7342a-4dc0-41e4-abc2-a8740ef6691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f7342a-4dc0-41e4-abc2-a8740ef6691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee01083-8524-4acc-ad62-517faf5307df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:39 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Volume 426b5b7e-c3c9-4216-864b-52cbe8f9d413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413', 'volume_size': 1} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-769162285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426b5b7e-c3c9-4216-864b-52cbe8f9d413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5c2bec28764130bb0568c0506c9102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:40Z,use_quota=True,user_id='83d58ccebfc242a29ab4b61bf52b771c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Creating volume 426b5b7e-c3c9-4216-864b-52cbe8f9d413 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:02:39 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:02:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:39 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 1073741824 Sep 08 19:02:39 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:40 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 1073741824" returned: 0 in 0.679s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:40 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 Sep 08 19:02:40 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:41 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413" returned: 0 in 0.388s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:02:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee01083-8524-4acc-ad62-517faf5307df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de5d54e-c209-4cc5-b5c6-eac81f51881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:41 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Volume volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 (426b5b7e-c3c9-4216-864b-52cbe8f9d413): created successfully Sep 08 19:02:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de5d54e-c209-4cc5-b5c6-eac81f51881b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Flow 'volume_create_manager' (50b07b10-747d-48d9-9119-09e697626b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3bd86719-6270-4605-923e-ee29bb5450d5 tempest-ServersNegativeTestJSON-1368051075 None] Created volume successfully. Sep 08 19:02:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "cinder-426b5b7e-c3c9-4216-864b-52cbe8f9d413-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-426b5b7e-c3c9-4216-864b-52cbe8f9d413-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "cinder-quobyte-426b5b7e-c3c9-4216-864b-52cbe8f9d413" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-quobyte-426b5b7e-c3c9-4216-864b-52cbe8f9d413" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:42 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[222494fa-7209-42fc-858f-315cd2daab37]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:02:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:42 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 Sep 08 19:02:42 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:43 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413" returned: 0 in 0.438s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:43 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413 Sep 08 19:02:43 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:43 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-426b5b7e-c3c9-4216-864b-52cbe8f9d413" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-quobyte-426b5b7e-c3c9-4216-864b-52cbe8f9d413" released by "delete_volume" :: held 0.906s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Created reservations ['07116c04-39ec-4ff0-aaa2-99700fa6ceb9', '1102b90d-afaa-4774-beb3-a6d8017801b9', 'b1246857-38a2-48af-a1c4-dae6a62ea03e', '3b4937e0-6edc-4928-b768-2b5dd18b2bcb'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:43 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:02:43 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "cinder-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "cinder-quobyte-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-quobyte-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb2533-d169-474f-8c06-7934da637b7f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Flow 'volume_create_manager' (7f100f47-7b0a-4311-a0df-30cf013cabe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d337fb4-c232-42dd-93e2-68c82c76d156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d337fb4-c232-42dd-93e2-68c82c76d156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-800591312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1e34da-9bbf-4bf5-8977-e3749033c195,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78a89fa8719b4182aa2868256e0930c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:44Z,use_quota=True,user_id='2069a9c0f0254e0585b4b90c5806277c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb86aac0-ef82-4562-80d3-e7a2af6ad898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb86aac0-ef82-4562-80d3-e7a2af6ad898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:44 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e Sep 08 19:02:44 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad24982-6625-45dc-b2f8-08d21fee5f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad24982-6625-45dc-b2f8-08d21fee5f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1e34da-9bbf-4bf5-8977-e3749033c195', 'volume_name': 'volume-eb1e34da-9bbf-4bf5-8977-e3749033c195', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e940f4e-8eb3-4ca3-87da-745b1d39a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e940f4e-8eb3-4ca3-87da-745b1d39a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efb22c-c775-4003-a0d7-c1f8a3d7fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:44 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Volume eb1e34da-9bbf-4bf5-8977-e3749033c195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1e34da-9bbf-4bf5-8977-e3749033c195', 'volume_size': 1} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-800591312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1e34da-9bbf-4bf5-8977-e3749033c195,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='78a89fa8719b4182aa2868256e0930c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:44Z,use_quota=True,user_id='2069a9c0f0254e0585b4b90c5806277c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Creating volume eb1e34da-9bbf-4bf5-8977-e3749033c195 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:02:44 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:44 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.548s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:02:44 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 1073741824 Sep 08 19:02:44 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Deleted volume successfully. Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e04f8edf-5bc4-4ad8-b5cf-a3f575e45e69 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-426b5b7e-c3c9-4216-864b-52cbe8f9d413-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:44 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e" returned: 0 in 0.577s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:44 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e Sep 08 19:02:44 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:44 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 1073741824" returned: 0 in 0.545s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:45 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 Sep 08 19:02:45 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:45 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e" returned: 0 in 0.325s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-quobyte-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e" released by "delete_volume" :: held 0.995s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Created reservations ['59a16af6-dd03-4b39-892d-a9ec2594994a', '9a376c7e-81f1-40d3-8837-0876b6cbb918', '891b8d17-481b-47ab-a30c-b3e33f26769d', '0139f671-ea30-44af-afd9-d9fe8df6c6ae'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:45 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:02:45 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:45 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195" returned: 0 in 0.341s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54efb22c-c775-4003-a0d7-c1f8a3d7fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1e34da-9bbf-4bf5-8977-e3749033c195', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282e03f0-3cd3-4b42-83b6-c4a275f261f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:45 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Volume volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 (eb1e34da-9bbf-4bf5-8977-e3749033c195): created successfully Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282e03f0-3cd3-4b42-83b6-c4a275f261f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Flow 'volume_create_manager' (7f100f47-7b0a-4311-a0df-30cf013cabe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-9f0f710a-5aa5-4e10-9858-67e6a14394e8 req-24735210-ab56-48dc-9e3e-9f85e93a9f97 tempest-VolumesGetTestJSON-2025474859 None] Created volume successfully. Sep 08 19:02:45 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.292s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:02:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Deleted volume successfully. Sep 08 19:02:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-022a50dc-54be-4fc1-8cae-d4e49833b296 tempest-ServersNegativeTestJSON-1368051075 None] Lock "cinder-f4fdca42-0b12-4f82-8baf-315d8a5cfc2e-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Acquiring lock "cinder-eb1e34da-9bbf-4bf5-8977-e3749033c195-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Lock "cinder-eb1e34da-9bbf-4bf5-8977-e3749033c195-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Acquiring lock "cinder-quobyte-eb1e34da-9bbf-4bf5-8977-e3749033c195" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Lock "cinder-quobyte-eb1e34da-9bbf-4bf5-8977-e3749033c195" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3307555-27f7-46e0-9c56-5f50ec896211]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:47 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 Sep 08 19:02:47 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:47 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195" returned: 0 in 0.442s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:47 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195 Sep 08 19:02:47 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:47 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb1e34da-9bbf-4bf5-8977-e3749033c195" returned: 0 in 0.276s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Lock "cinder-quobyte-eb1e34da-9bbf-4bf5-8977-e3749033c195" released by "delete_volume" :: held 0.766s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:47 devstack cinder-volume[87538]: DEBUG cinder.quota [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Created reservations ['052283d2-bb1b-4009-81f6-3f9b77c66571', '85d335ba-7333-4b50-a79e-c48af75525b6', '16752a12-c7bb-4b36-bdd6-db68950326ac', 'f48cdc35-754d-459a-882d-96d9d83f41a9'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:48 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:02:48 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:48 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.591s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG cinder.manager [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:02:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Deleted volume successfully. Sep 08 19:02:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-864945b0-d696-4209-8cd1-a6bfb90fdbfa req-1b86b269-a84c-4160-8bfc-e3d3e4b7ba2e tempest-VolumesGetTestJSON-2025474859 None] Lock "cinder-eb1e34da-9bbf-4bf5-8977-e3749033c195-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:02:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d9f40ce6-11eb-4cdf-b2e1-5ee5e95c4494 tempest-GroupSnapshotsV319Test-1604266300 None] Group tempest-GroupSnapshotsV319Test-Group-2146256680: creating Sep 08 19:02:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d9f40ce6-11eb-4cdf-b2e1-5ee5e95c4494 tempest-GroupSnapshotsV319Test-1604266300 None] Group tempest-GroupSnapshotsV319Test-Group-2146256680: created successfully Sep 08 19:02:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d9f40ce6-11eb-4cdf-b2e1-5ee5e95c4494 tempest-GroupSnapshotsV319Test-1604266300 None] Create group completed successfully. Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Flow 'volume_create_manager' (b2b43bf9-131f-456d-ac4d-bcc1fe78654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f416a474-c124-4e6c-b365-f3c7499ea230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f416a474-c124-4e6c-b365-f3c7499ea230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1551434411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=130de9cd-db2c-469e-bc5e-bc7b9e63cae6,host='devstack@QuobyteHD#QuobyteHD',id=93554328-1adf-4ace-85a6-f90da81b8617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0121dd19a87b4e1b8a479dcff5fece2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:58Z,use_quota=True,user_id='5723bd3364a34bf2a538fa454d9484a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dda0b404-68ae-4e42-9cc0-27bf72be82d4),volume_type_id=dda0b404-68ae-4e42-9cc0-27bf72be82d4)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3138fc6e-990d-400a-9a61-17b5c11234a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3138fc6e-990d-400a-9a61-17b5c11234a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65e5019-7dea-4217-bd40-5cf5402578cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65e5019-7dea-4217-bd40-5cf5402578cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93554328-1adf-4ace-85a6-f90da81b8617', 'volume_name': 'volume-93554328-1adf-4ace-85a6-f90da81b8617', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33e33f3-783a-436f-9b13-09a364953371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33e33f3-783a-436f-9b13-09a364953371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e145377c-5434-4a37-9086-11628503a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:57 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Volume 93554328-1adf-4ace-85a6-f90da81b8617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93554328-1adf-4ace-85a6-f90da81b8617', 'volume_size': 1} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=130de9cd-db2c-469e-bc5e-bc7b9e63cae6,created_at=2026-09-08T17:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1551434411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=130de9cd-db2c-469e-bc5e-bc7b9e63cae6,host='devstack@QuobyteHD#QuobyteHD',id=93554328-1adf-4ace-85a6-f90da81b8617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0121dd19a87b4e1b8a479dcff5fece2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:58Z,use_quota=True,user_id='5723bd3364a34bf2a538fa454d9484a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dda0b404-68ae-4e42-9cc0-27bf72be82d4),volume_type_id=dda0b404-68ae-4e42-9cc0-27bf72be82d4)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Creating volume 93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:02:57 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:02:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:57 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 1073741824 Sep 08 19:02:57 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:58 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 1073741824" returned: 0 in 0.560s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:58 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 Sep 08 19:02:58 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:58 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617" returned: 0 in 0.286s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e145377c-5434-4a37-9086-11628503a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93554328-1adf-4ace-85a6-f90da81b8617', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed97ea3-78b0-4f7d-9dd1-e165ce6d6af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:58 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Volume volume-93554328-1adf-4ace-85a6-f90da81b8617 (93554328-1adf-4ace-85a6-f90da81b8617): created successfully Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed97ea3-78b0-4f7d-9dd1-e165ce6d6af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Flow 'volume_create_manager' (b2b43bf9-131f-456d-ac4d-bcc1fe78654b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3f9f9bf3-1e19-4e3e-96bd-70be53babaff tempest-GroupSnapshotsV319Test-1604266300 None] Created volume successfully. Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Flow 'volume_create_manager' (19f84112-971e-4d87-8907-132f46a81a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cdc97b8-19e0-4b52-976d-34242af3cb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cdc97b8-19e0-4b52-976d-34242af3cb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2132905401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4db7f2-9487-4e09-ba2c-98db096c9e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eb106d1cd049e1a214538ab1bd080d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:59Z,use_quota=True,user_id='39d2acdce07e4fbf9e085bed545aedf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbddc740-ac10-45c8-ab15-42e4e850ec25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbddc740-ac10-45c8-ab15-42e4e850ec25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8e6f3a-a80c-47fa-8745-658b1955d75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8e6f3a-a80c-47fa-8745-658b1955d75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4db7f2-9487-4e09-ba2c-98db096c9e3f', 'volume_name': 'volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a8d465-505b-4001-840e-e695eb0d23ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a8d465-505b-4001-840e-e695eb0d23ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58a78e4-b600-41ef-aa6b-e802f4d612bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:02:59 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Volume bc4db7f2-9487-4e09-ba2c-98db096c9e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f', 'volume_size': 1} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2132905401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4db7f2-9487-4e09-ba2c-98db096c9e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eb106d1cd049e1a214538ab1bd080d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:02:59Z,use_quota=True,user_id='39d2acdce07e4fbf9e085bed545aedf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Creating volume bc4db7f2-9487-4e09-ba2c-98db096c9e3f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:02:59 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:59 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f 1073741824 Sep 08 19:02:59 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:02:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] GroupSnapshot 7acde0fb-0dee-4714-aade-2d05bc8a78da: creating. Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Group snapshot 7acde0fb-0dee-4714-aade-2d05bc8a78da: creating. {{(pid=87538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:02:59 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f 1073741824" returned: 0 in 0.767s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:02:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:02:59 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f Sep 08 19:02:59 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:00 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f" returned: 0 in 0.417s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.578s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58a78e4-b600-41ef-aa6b-e802f4d612bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ea5a21-ba38-4a4d-b664-f734eb499cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Creating offline snapshot 6f5412fb-5eae-4dc0-b279-863d7fb40ce3 of volume 93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307f268-b36a-4155-acbe-56e700c2f231]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:00 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Volume volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f (bc4db7f2-9487-4e09-ba2c-98db096c9e3f): created successfully Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ea5a21-ba38-4a4d-b664-f734eb499cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Flow 'volume_create_manager' (19f84112-971e-4d87-8907-132f46a81a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ae61dd66-c5b7-4010-b100-dfc794bddd3c tempest-ServerActionsTestOtherA-151525973 None] Created volume successfully. Sep 08 19:03:00 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 Sep 08 19:03:00 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:00 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617" returned: 0 in 0.523s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:00 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 1G Sep 08 19:03:00 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:01 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 1G" returned: 0 in 0.682s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93554328-1adf-4ace-85a6-f90da81b8617 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:01 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93554328-1adf-4ace-85a6-f90da81b8617 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 Sep 08 19:03:01 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:01 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8cd96943-ae9a-4640-85b3-61780eecd818 tempest-GroupSnapshotsTest-450460635 None] Group tempest-GroupSnapshotsTest-Group-33820775: creating Sep 08 19:03:01 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8cd96943-ae9a-4640-85b3-61780eecd818 tempest-GroupSnapshotsTest-450460635 None] Group tempest-GroupSnapshotsTest-Group-33820775: created successfully Sep 08 19:03:01 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8cd96943-ae9a-4640-85b3-61780eecd818 tempest-GroupSnapshotsTest-450460635 None] Create group completed successfully. Sep 08 19:03:02 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93554328-1adf-4ace-85a6-f90da81b8617 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3" returned: 0 in 0.473s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:02 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:02 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 Sep 08 19:03:02 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:02 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3" returned: 0 in 0.494s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:02 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.info Sep 08 19:03:02 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:03 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.info" returned: 0 in 0.674s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:03 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:03 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.info Sep 08 19:03:03 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:03 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.info" returned: 0 in 0.323s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.340s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:03 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-141c2793-d16e-4674-8c95-415968af1fb8 tempest-GroupSnapshotsV319Test-1604266300 None] group_snapshot 7acde0fb-0dee-4714-aade-2d05bc8a78da: created successfully Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (6b4b53c1-838d-417d-9a0c-af2f3dc87cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a00301-062b-4631-bc3f-1dc957968998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a00301-062b-4631-bc3f-1dc957968998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77033240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a4e2a97-f43e-4617-9900-d992a00c6767,host='devstack@QuobyteHD#QuobyteHD',id=e78e6e6e-42ce-40c5-9978-de54b33eb336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:04Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff7ee71-bbe3-4d81-a7e6-181de09cdb18),volume_type_id=aff7ee71-bbe3-4d81-a7e6-181de09cdb18)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced7733-d77c-45cc-bafe-1d2650988ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced7733-d77c-45cc-bafe-1d2650988ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ab7d6b-fa8d-4243-9447-ca90807e0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ab7d6b-fa8d-4243-9447-ca90807e0885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e78e6e6e-42ce-40c5-9978-de54b33eb336', 'volume_name': 'volume-e78e6e6e-42ce-40c5-9978-de54b33eb336', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9993d8-f97b-404b-86e5-3288e60ec1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9993d8-f97b-404b-86e5-3288e60ec1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b648773-a15e-440e-a7fd-2bd7fd1c358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Volume e78e6e6e-42ce-40c5-9978-de54b33eb336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e78e6e6e-42ce-40c5-9978-de54b33eb336', 'volume_size': 1} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a4e2a97-f43e-4617-9900-d992a00c6767,created_at=2026-09-08T17:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-77033240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a4e2a97-f43e-4617-9900-d992a00c6767,host='devstack@QuobyteHD#QuobyteHD',id=e78e6e6e-42ce-40c5-9978-de54b33eb336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:04Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aff7ee71-bbe3-4d81-a7e6-181de09cdb18),volume_type_id=aff7ee71-bbe3-4d81-a7e6-181de09cdb18)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Creating volume e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:03:04 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:04 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 1073741824 Sep 08 19:03:04 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:04 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 1073741824" returned: 0 in 0.675s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] group_snapshot 7acde0fb-0dee-4714-aade-2d05bc8a78da: deleting Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:04 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 Sep 08 19:03:04 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] group_snapshot 7acde0fb-0dee-4714-aade-2d05bc8a78da: deleting {{(pid=87538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Acquiring lock "cinder-quobyte-93554328-1adf-4ace-85a6-f90da81b8617" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Lock "cinder-quobyte-93554328-1adf-4ace-85a6-f90da81b8617" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Acquiring lock "cinder-quobyte-6f5412fb-5eae-4dc0-b279-863d7fb40ce3" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Lock "cinder-quobyte-6f5412fb-5eae-4dc0-b279-863d7fb40ce3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Deleting offline snapshot 6f5412fb-5eae-4dc0-b279-863d7fb40ce3 of volume 93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:03:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] snapshot_file for this snap is: volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa3a79f-6022-4671-8322-9473477a6fc1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:05 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 Sep 08 19:03:05 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:05 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336" returned: 0 in 0.457s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b648773-a15e-440e-a7fd-2bd7fd1c358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e78e6e6e-42ce-40c5-9978-de54b33eb336', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ccf6e5-fa89-47de-841c-0dbcd368d035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:05 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Volume volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 (e78e6e6e-42ce-40c5-9978-de54b33eb336): created successfully Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ccf6e5-fa89-47de-841c-0dbcd368d035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (6b4b53c1-838d-417d-9a0c-af2f3dc87cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-191b913a-d0e0-46df-9228-e1173fa9237a tempest-GroupSnapshotsTest-450460635 None] Created volume successfully. Sep 08 19:03:05 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3" returned: 0 in 0.518s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93554328-1adf-4ace-85a6-f90da81b8617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f707946-cb6b-47b3-b652-7565dd6123a9]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:05 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 Sep 08 19:03:05 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617" returned: 0 in 0.465s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:06 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:06 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 Sep 08 19:03:06 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:06 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3" returned: 0 in 0.830s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:06 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3 Sep 08 19:03:06 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] GroupSnapshot 54f306d0-1f19-4b2b-b00b-0b36e90c94e7: creating. Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Group snapshot 54f306d0-1f19-4b2b-b00b-0b36e90c94e7: creating. {{(pid=87538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Creating offline snapshot 7fb5532c-c3f6-41be-b090-d21a86d6ae76 of volume e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:07 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617.6f5412fb-5eae-4dc0-b279-863d7fb40ce3" returned: 0 in 0.644s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d94916-84b3-41ec-96cd-66f4246ce8cb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Lock "cinder-quobyte-6f5412fb-5eae-4dc0-b279-863d7fb40ce3" released by "_delete_snapshot" :: held 2.619s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Lock "cinder-quobyte-93554328-1adf-4ace-85a6-f90da81b8617" released by "delete_snapshot" :: held 2.668s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:07 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 Sep 08 19:03:07 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:07 devstack cinder-volume[87538]: WARNING cinder.quota [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1384774022 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1384774022, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:07 devstack cinder-volume[87538]: WARNING cinder.quota [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1384774022 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1384774022, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:07 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] Created reservations ['255f5489-6ad1-4908-a9b9-996031059efa', 'a82be3d0-ee2b-4c3c-a09a-575fbdc80169', '282516e2-7679-4b41-9e6e-5dcb80380dc0', 'dadc624d-334e-4190-8fcf-e37664f5f9e7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-cd581651-3bd6-45c6-a496-30fb84ff439e tempest-GroupSnapshotsV319Test-1604266300 None] group_snapshot 7acde0fb-0dee-4714-aade-2d05bc8a78da: deleted successfully Sep 08 19:03:08 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336" returned: 0 in 0.566s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:08 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 1G Sep 08 19:03:08 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:08 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 1G" returned: 0 in 0.772s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:08 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 Sep 08 19:03:08 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Acquiring lock "cinder-quobyte-93554328-1adf-4ace-85a6-f90da81b8617" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Lock "cinder-quobyte-93554328-1adf-4ace-85a6-f90da81b8617" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b5d99-b70a-4eb5-b5f1-6c17d5562373]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:09 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 Sep 08 19:03:09 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:09 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76" returned: 0 in 0.460s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:09 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:09 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 Sep 08 19:03:09 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:09 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76" returned: 0 in 0.459s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:09 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617" returned: 0 in 0.778s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:09 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.info Sep 08 19:03:09 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:09 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617 Sep 08 19:03:09 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:10 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.info" returned: 0 in 0.422s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:10 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:10 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-93554328-1adf-4ace-85a6-f90da81b8617" returned: 0 in 0.423s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:10 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.info Sep 08 19:03:10 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Lock "cinder-quobyte-93554328-1adf-4ace-85a6-f90da81b8617" released by "delete_volume" :: held 1.318s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Created reservations ['e31df16c-433a-4c6d-bea8-8bf775a35198'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:10 devstack cinder-volume[87538]: WARNING cinder.quota [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1384774022 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1384774022, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Created reservations ['300f047c-300e-4511-87c0-37753ee5e510', 'e8c7b632-ca23-4848-8414-94f953fd95ec', '54e5e343-ed65-4648-9b18-f0fa9666824a', '66541994-71e2-4916-ab0b-f70e1172e673'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:10 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.info" returned: 0 in 0.501s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.362s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:10 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:03:10 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c60b4cf7-5889-4577-9479-c0cc4e53a8be tempest-GroupSnapshotsTest-450460635 None] group_snapshot 54f306d0-1f19-4b2b-b00b-0b36e90c94e7: created successfully Sep 08 19:03:11 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.427s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:11 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:03:11 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5f2f64a7-9b8a-49eb-879d-64f554ef6f0a tempest-GroupSnapshotsV319Test-1604266300 None] Delete group completed successfully. Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-7fb5532c-c3f6-41be-b090-d21a86d6ae76-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-7fb5532c-c3f6-41be-b090-d21a86d6ae76-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Creating volume daea2de5-01b8-4ee7-b42e-4e0f7217fd2a from snapshot 7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] snapshot: 7fb5532c-c3f6-41be-b090-d21a86d6ae76, volume: daea2de5-01b8-4ee7-b42e-4e0f7217fd2a, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[254ceb67-59da-418c-9779-3f9e432a43fb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:13 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 Sep 08 19:03:13 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:14 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76" returned: 0 in 0.959s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e78e6e6e-42ce-40c5-9978-de54b33eb336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d044078b-220d-4cf0-94e5-54acb5dd09db]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:14 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 Sep 08 19:03:14 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:14 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336" returned: 0 in 0.580s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:03:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:15 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a Sep 08 19:03:15 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:23 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=55,cinder:UPDATE=70,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:03:23 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=64,cinder:INSERT=15,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:03:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" returned: 0 in 10.039s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:25 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:03:25 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Converted 1024.00 MB image at 101.99 MB/s Sep 08 19:03:25 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:25 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a Sep 08 19:03:25 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:25 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" released by "_copy_volume_from_snapshot" :: held 12.151s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-7fb5532c-c3f6-41be-b090-d21a86d6ae76-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" released by "_create_volume_from_snapshot" :: held 12.280s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.300s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3437d30d-9474-402c-a24b-341efda75283 tempest-GroupSnapshotsTest-450460635 None] Create group from source-snapshot-54f306d0-1f19-4b2b-b00b-0b36e90c94e7 completed successfully. Sep 08 19:03:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:26 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa66052-531b-4d71-b8d2-949bbdf052f2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:26 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a Sep 08 19:03:26 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:27 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" returned: 0 in 0.451s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:27 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a Sep 08 19:03:27 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:27 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" returned: 0 in 0.254s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-daea2de5-01b8-4ee7-b42e-4e0f7217fd2a" released by "delete_volume" :: held 0.769s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Created reservations ['1e25980d-ef02-425a-844c-8dafab115ad8'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:27 devstack cinder-volume[87538]: WARNING cinder.quota [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-749316272 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-749316272, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:27 devstack cinder-volume[87538]: WARNING cinder.quota [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-749316272 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-749316272, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Created reservations ['b7f730c0-cb66-4e86-be87-7bb14b161701', 'c8ce2ff5-1c9e-42e4-8a9c-3fa999a5ee6c', '8ec323a8-b3ab-4dfc-b4c5-7751f44ec526', 'ad614e12-bdc5-41d2-92c0-f49d458b3b19'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:27 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:03:27 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] group_snapshot 54f306d0-1f19-4b2b-b00b-0b36e90c94e7: deleting Sep 08 19:03:27 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.336s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:03:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-395ba1b5-a7bb-43d2-8e4c-e4209ab9764e tempest-GroupSnapshotsTest-450460635 None] Delete group completed successfully. Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] group_snapshot 54f306d0-1f19-4b2b-b00b-0b36e90c94e7: deleting {{(pid=87538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-e78e6e6e-42ce-40c5-9978-de54b33eb336" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-e78e6e6e-42ce-40c5-9978-de54b33eb336" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-7fb5532c-c3f6-41be-b090-d21a86d6ae76" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-7fb5532c-c3f6-41be-b090-d21a86d6ae76" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Deleting offline snapshot 7fb5532c-c3f6-41be-b090-d21a86d6ae76 of volume e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] snapshot_file for this snap is: volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd0af9d-428f-4350-bbdb-3d2f06ce6cd2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:28 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 Sep 08 19:03:28 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:28 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76" returned: 0 in 0.398s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e78e6e6e-42ce-40c5-9978-de54b33eb336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c6113-cf64-4d69-825f-e1cc7a6f15c0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:28 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 Sep 08 19:03:28 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:28 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336" returned: 0 in 0.517s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:29 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 Sep 08 19:03:29 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:29 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76" returned: 0 in 0.361s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:29 devstack sudo[91217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76 Sep 08 19:03:29 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:29 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336.7fb5532c-c3f6-41be-b090-d21a86d6ae76" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-7fb5532c-c3f6-41be-b090-d21a86d6ae76" released by "_delete_snapshot" :: held 1.701s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-e78e6e6e-42ce-40c5-9978-de54b33eb336" released by "delete_snapshot" :: held 1.743s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:29 devstack cinder-volume[87538]: WARNING cinder.quota [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-749316272 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-749316272, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:29 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] Created reservations ['a3529f2a-ddb0-4870-843d-6857a09e82f9', 'a2851306-96b9-4b49-a4dc-a67eb825ef71', 'cd3dfc2d-ff82-4318-afbe-aaa0a96ecd89', '6cd168d2-67ec-4d81-b5fb-3875268138d7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-be2011de-f065-4ad1-bdcb-60858723352d tempest-GroupSnapshotsTest-450460635 None] group_snapshot 54f306d0-1f19-4b2b-b00b-0b36e90c94e7: deleted successfully Sep 08 19:03:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-e78e6e6e-42ce-40c5-9978-de54b33eb336" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-e78e6e6e-42ce-40c5-9978-de54b33eb336" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:30 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c21797-fbb3-4666-9d3f-abc082b373c8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:30 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 Sep 08 19:03:30 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:31 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336" returned: 0 in 0.405s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:31 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336 Sep 08 19:03:31 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:31 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e78e6e6e-42ce-40c5-9978-de54b33eb336" returned: 0 in 0.271s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-e78e6e6e-42ce-40c5-9978-de54b33eb336" released by "delete_volume" :: held 0.786s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Created reservations ['32d91c0c-e6e2-4a4d-8459-94de4b514765'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:31 devstack cinder-volume[87538]: WARNING cinder.db.api [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-749316272'] Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Created reservations ['39e3f5ba-88b6-4874-ab9e-17b1a3bd9493', '9136a43a-385f-4084-a7ab-50e54bdca051', '419d4a6e-df31-4361-b12a-c5668ef6e2a8', 'cc83b2bf-3593-43c6-bddf-87f773de915c'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:31 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:03:31 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:31 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:31 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:03:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b2fbbdcf-9854-47be-a6c7-38b5052ae124 tempest-GroupSnapshotsTest-450460635 None] Delete group completed successfully. Sep 08 19:03:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ceb50044-7229-4640-a458-1ea82f8dfa0b tempest-GroupSnapshotsTest-450460635 None] Group tempest-GroupSnapshotsTest-Group-260529650: creating Sep 08 19:03:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ceb50044-7229-4640-a458-1ea82f8dfa0b tempest-GroupSnapshotsTest-450460635 None] Group tempest-GroupSnapshotsTest-Group-260529650: created successfully Sep 08 19:03:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ceb50044-7229-4640-a458-1ea82f8dfa0b tempest-GroupSnapshotsTest-450460635 None] Create group completed successfully. Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (3b1e1fe2-929c-4c13-967d-5a5a8d519c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787db9cc-99c5-4c51-9ecf-7fd989043993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787db9cc-99c5-4c51-9ecf-7fd989043993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1179621366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1392b45-4fab-402e-bf12-570cee817a16,host='devstack@QuobyteHD#QuobyteHD',id=b53afab5-6514-42df-8393-b95083268a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:34Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc),volume_type_id=a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd461171-2ded-47c7-9df5-64eba951124b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd461171-2ded-47c7-9df5-64eba951124b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0dfbdc-aae1-4333-9c76-e94f77ef1d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0dfbdc-aae1-4333-9c76-e94f77ef1d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b53afab5-6514-42df-8393-b95083268a23', 'volume_name': 'volume-b53afab5-6514-42df-8393-b95083268a23', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddc14dd-42f5-4462-bfa9-96e7fe302c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddc14dd-42f5-4462-bfa9-96e7fe302c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8deca5-75bf-47d9-b39f-eea35bb96675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:33 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Volume b53afab5-6514-42df-8393-b95083268a23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b53afab5-6514-42df-8393-b95083268a23', 'volume_size': 1} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a1392b45-4fab-402e-bf12-570cee817a16,created_at=2026-09-08T17:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1179621366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1392b45-4fab-402e-bf12-570cee817a16,host='devstack@QuobyteHD#QuobyteHD',id=b53afab5-6514-42df-8393-b95083268a23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:34Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc),volume_type_id=a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Creating volume b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:03:33 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:03:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:33 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 1073741824 Sep 08 19:03:33 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:34 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:03:34 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:34 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 1073741824" returned: 0 in 0.469s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:34 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 Sep 08 19:03:34 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Flow 'volume_create_manager' (adf32a35-03b7-4da8-a8c3-2e008a9b1d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954ea35e-2a28-42e1-95e6-672cb7405a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:34 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 8 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954ea35e-2a28-42e1-95e6-672cb7405a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1987998346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92950c08-86cf-49c1-909c-adfacdd265d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05d9f215b7ff4c65af31adb34ed3530a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:35Z,use_quota=True,user_id='0da92d81b52c4bc9ad387fb7ec52c7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17f7794-2834-4b90-9d91-7ca5432f587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17f7794-2834-4b90-9d91-7ca5432f587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ccf569-dfac-4069-b46d-d866189e6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ccf569-dfac-4069-b46d-d866189e6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92950c08-86cf-49c1-909c-adfacdd265d2', 'volume_name': 'volume-92950c08-86cf-49c1-909c-adfacdd265d2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93f7b39-6296-46f2-8580-dbd55fa040d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93f7b39-6296-46f2-8580-dbd55fa040d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ac7dc6-d4ce-4251-93b9-85f4035ef333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Volume 92950c08-86cf-49c1-909c-adfacdd265d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92950c08-86cf-49c1-909c-adfacdd265d2', 'volume_size': 1} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:34 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23" returned: 0 in 0.249s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1987998346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92950c08-86cf-49c1-909c-adfacdd265d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05d9f215b7ff4c65af31adb34ed3530a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:35Z,use_quota=True,user_id='0da92d81b52c4bc9ad387fb7ec52c7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Creating volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:03:34 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:34 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 1073741824 Sep 08 19:03:34 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8deca5-75bf-47d9-b39f-eea35bb96675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53afab5-6514-42df-8393-b95083268a23', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0788cd78-34e2-488a-bceb-9d69bef00f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Volume volume-b53afab5-6514-42df-8393-b95083268a23 (b53afab5-6514-42df-8393-b95083268a23): created successfully Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0788cd78-34e2-488a-bceb-9d69bef00f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (3b1e1fe2-929c-4c13-967d-5a5a8d519c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b20f26de-ba46-4473-88bb-5db4b6a8d5b8 tempest-GroupSnapshotsTest-450460635 None] Created volume successfully. Sep 08 19:03:35 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 1073741824" returned: 0 in 0.435s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:35 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 Sep 08 19:03:35 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:35 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ac7dc6-d4ce-4251-93b9-85f4035ef333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92950c08-86cf-49c1-909c-adfacdd265d2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90749644-8945-41f2-a588-eb1c70492a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Volume volume-92950c08-86cf-49c1-909c-adfacdd265d2 (92950c08-86cf-49c1-909c-adfacdd265d2): created successfully Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90749644-8945-41f2-a588-eb1c70492a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Flow 'volume_create_manager' (adf32a35-03b7-4da8-a8c3-2e008a9b1d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d00fcb7f-89e5-4348-92e7-76ebce814431 tempest-SnapshotsActionsTest-2091053524 None] Created volume successfully. Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (3368eecd-fba7-4761-aaad-003aafeea00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd89b1a4-cb71-41ad-9996-f60c8de5b604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd89b1a4-cb71-41ad-9996-f60c8de5b604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906348744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1392b45-4fab-402e-bf12-570cee817a16,host='devstack@QuobyteHD#QuobyteHD',id=8e1e3545-acd2-4ffa-881b-efa12d32b8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:36Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc),volume_type_id=a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ae1d9e-c03d-45c6-8faa-f3b637d646c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75ae1d9e-c03d-45c6-8faa-f3b637d646c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf67e690-03c0-4894-9515-2a8e01bdca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf67e690-03c0-4894-9515-2a8e01bdca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1e3545-acd2-4ffa-881b-efa12d32b8d9', 'volume_name': 'volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea14d2c5-75a5-4c86-9dd8-b4db8d7b6859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea14d2c5-75a5-4c86-9dd8-b4db8d7b6859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22e4562-2074-4f07-9098-a7369f7e888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Volume 8e1e3545-acd2-4ffa-881b-efa12d32b8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9', 'volume_size': 1} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a1392b45-4fab-402e-bf12-570cee817a16,created_at=2026-09-08T17:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906348744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1392b45-4fab-402e-bf12-570cee817a16,host='devstack@QuobyteHD#QuobyteHD',id=8e1e3545-acd2-4ffa-881b-efa12d32b8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:36Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc),volume_type_id=a4d3e2a5-e9fc-48b9-af4a-d43fe1bb6ccc)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Creating volume 8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:03:35 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:03:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:35 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 1073741824 Sep 08 19:03:35 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:36 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 1073741824" returned: 0 in 0.548s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:36 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 Sep 08 19:03:36 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:36 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" returned: 0 in 0.317s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Flow 'volume_create_manager' (e58d85ab-1477-42ab-bc46-23e780ad8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16d351f-127c-4ad0-ab5d-1bc881a1b59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22e4562-2074-4f07-9098-a7369f7e888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825e9973-eec8-4850-be63-a8b4b24c778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16d351f-127c-4ad0-ab5d-1bc881a1b59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-68725123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97b0f36-8e0b-460a-a5ac-9dafac7302c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2606b6f1149d8b42b4dd3c1d6af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:37Z,use_quota=True,user_id='9bc1b0635c314911ade50fdccf38af9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc319b2-7017-4e21-88b7-01c587323c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc319b2-7017-4e21-88b7-01c587323c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d58272f-a651-4f0a-b09b-d27f79de2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d58272f-a651-4f0a-b09b-d27f79de2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97b0f36-8e0b-460a-a5ac-9dafac7302c5', 'volume_name': 'volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7243a599-72f7-4afc-a900-f78779677f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7243a599-72f7-4afc-a900-f78779677f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afa357e-aa40-4c75-97ac-9c1fbba1b6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Volume c97b0f36-8e0b-460a-a5ac-9dafac7302c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5', 'volume_size': 1} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-68725123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97b0f36-8e0b-460a-a5ac-9dafac7302c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2606b6f1149d8b42b4dd3c1d6af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:03:37Z,use_quota=True,user_id='9bc1b0635c314911ade50fdccf38af9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Creating volume c97b0f36-8e0b-460a-a5ac-9dafac7302c5 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:03:36 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Volume volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 (8e1e3545-acd2-4ffa-881b-efa12d32b8d9): created successfully Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825e9973-eec8-4850-be63-a8b4b24c778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (3368eecd-fba7-4761-aaad-003aafeea00a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:36 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 1073741824 Sep 08 19:03:36 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b86ee363-5d5f-4dc5-8527-3c7fcabe46d4 tempest-GroupSnapshotsTest-450460635 None] Created volume successfully. Sep 08 19:03:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:37 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 1073741824" returned: 0 in 0.511s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:37 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 Sep 08 19:03:37 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:37 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5" returned: 0 in 0.255s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.621s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afa357e-aa40-4c75-97ac-9c1fbba1b6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b1e412-70ca-4879-a99e-b486a69843e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Creating offline snapshot 28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:37 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Volume volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 (c97b0f36-8e0b-460a-a5ac-9dafac7302c5): created successfully Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b1e412-70ca-4879-a99e-b486a69843e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Flow 'volume_create_manager' (e58d85ab-1477-42ab-bc46-23e780ad8946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce88f815-eaa3-4c05-90c6-228f913b489f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a5081b0a-e377-4b07-acbe-70792838f818 tempest-AttachVolumeTestJSON-720472429 None] Created volume successfully. Sep 08 19:03:37 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 Sep 08 19:03:37 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:37 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2" returned: 0 in 0.385s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:38 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 1G Sep 08 19:03:38 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-34d06f4d-e12d-4e8a-8337-8ac1b8f69b79 tempest-GroupSnapshotsTest-450460635 None] Update group completed successfully. Sep 08 19:03:38 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 1G" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:38 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:38 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:38 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.288s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:38 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 is being set with open permissions: ugo+rw Sep 08 19:03:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:38 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:38 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:38 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.255s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:38 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.info Sep 08 19:03:38 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:39 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.info" returned: 0 in 0.263s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:39 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.info is being set with open permissions: ugo+rw Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:39 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.info Sep 08 19:03:39 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-321fb8be-0d88-4a7e-a662-80eb5d8dc012 tempest-GroupSnapshotsTest-450460635 None] Update group completed successfully. Sep 08 19:03:39 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.info" returned: 0 in 0.269s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-74bb9dc8-1ba9-4e18-b75b-05f804f03a9e tempest-SnapshotsActionsTest-2091053524 None] Create snapshot completed successfully Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-78de2c8d-0b38-4bdc-ba49-0f6f0b338a6c req-22f23ad3-6658-4316-a235-6817e5ab4c85 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-78de2c8d-0b38-4bdc-ba49-0f6f0b338a6c req-22f23ad3-6658-4316-a235-6817e5ab4c85 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-78de2c8d-0b38-4bdc-ba49-0f6f0b338a6c req-22f23ad3-6658-4316-a235-6817e5ab4c85 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-78de2c8d-0b38-4bdc-ba49-0f6f0b338a6c req-22f23ad3-6658-4316-a235-6817e5ab4c85 tempest-AttachVolumeTestJSON-720472429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a003ebb-c32b-44d2-8dff-8db5430d02a8', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:03:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-78de2c8d-0b38-4bdc-ba49-0f6f0b338a6c req-22f23ad3-6658-4316-a235-6817e5ab4c85 tempest-AttachVolumeTestJSON-720472429 None] attachment_update completed successfully. Sep 08 19:03:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9d5295eb-2cea-4943-a59d-64dea4f26b47 tempest-GroupSnapshotsTest-450460635 None] Update group completed successfully. Sep 08 19:03:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Creating offline snapshot 3421d63d-01e6-4e34-926d-d529a51e7f5d of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:40 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[76461eb3-c495-4568-af85-90b893ca5765]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:40 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:40 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:41 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.415s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:41 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d 1G Sep 08 19:03:41 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:41 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d 1G" returned: 0 in 0.466s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:41 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d Sep 08 19:03:41 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ed39762e-554a-4f35-acad-7794c268b8d2 tempest-GroupSnapshotsTest-450460635 None] Update group completed successfully. Sep 08 19:03:41 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d" returned: 0 in 0.292s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:41 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d is being set with open permissions: ugo+rw Sep 08 19:03:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:41 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d Sep 08 19:03:41 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:42 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d" returned: 0 in 0.230s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.511s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:42 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-59261bc9-f393-4085-a0a3-8e42be7c4c7c tempest-SnapshotsActionsTest-2091053524 None] Create snapshot completed successfully Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-3421d63d-01e6-4e34-926d-d529a51e7f5d-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-3421d63d-01e6-4e34-926d-d529a51e7f5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-3421d63d-01e6-4e34-926d-d529a51e7f5d" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-3421d63d-01e6-4e34-926d-d529a51e7f5d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Deleting offline snapshot 3421d63d-01e6-4e34-926d-d529a51e7f5d of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] snapshot_file for this snap is: volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a992f7-3f69-4323-ad11-58622a4b9faa]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:43 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d Sep 08 19:03:43 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] GroupSnapshot 9c74b244-26fb-4f92-ad20-796577006f55: creating. Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Group snapshot 9c74b244-26fb-4f92-ad20-796577006f55: creating. {{(pid=87538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Creating offline snapshot 972f380e-129f-47ce-9745-3e3fc6f5ebe1 of volume 8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad115e21-c9eb-43ec-b972-16f2b4a35aaf]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:43 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 Sep 08 19:03:43 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:43 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d" returned: 0 in 0.607s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be97abb-37f1-44dc-9b01-5a10f36804c8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:43 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:43 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:44 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" returned: 0 in 0.785s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:44 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 1G Sep 08 19:03:44 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:44 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.627s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:44 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d Sep 08 19:03:44 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:44 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 1G" returned: 0 in 0.605s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:44 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 Sep 08 19:03:44 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d" returned: 0 in 0.629s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:45 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:45 devstack sudo[91894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d Sep 08 19:03:45 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:45 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1" returned: 0 in 0.703s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:45 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-8f1005c8-5de9-40b5-9170-8bde8ab201e7 req-e6a5e71a-c220-417d-924d-8616db62d3d8 tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:45 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 Sep 08 19:03:45 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:45 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.3421d63d-01e6-4e34-926d-d529a51e7f5d" returned: 0 in 0.567s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-3421d63d-01e6-4e34-926d-d529a51e7f5d" released by "_delete_snapshot" :: held 2.580s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" released by "delete_snapshot" :: held 2.620s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:45 devstack cinder-volume[87538]: WARNING cinder.quota [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Created reservations ['dec8e04c-9d85-4e75-85a5-7cb80b533215', 'f15c6459-4db9-4144-befe-d1cf2f420b27', '65ac92a6-d7bf-4b9c-86c4-9b13d45c8d19', 'e0810a7c-ca1e-46e6-8db2-b77b41016605'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Delete snapshot completed successfully. Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34d93bf6-504f-4422-88a3-a68947dffac5 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-3421d63d-01e6-4e34-926d-d529a51e7f5d-delete_snapshot" released by "delete_snapshot" :: held 2.907s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:45 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1" returned: 0 in 0.485s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:46 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.info Sep 08 19:03:46 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:46 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.info" returned: 0 in 0.345s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:46 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:46 devstack sudo[92283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.info Sep 08 19:03:46 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:46 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.info" returned: 0 in 0.308s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.409s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Creating offline snapshot cf47ab69-7064-4184-95b4-17fb51aa1e71 of volume b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d03c5-14df-4076-b19c-2a0e134ae31d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:46 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 Sep 08 19:03:46 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:47 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23" returned: 0 in 0.419s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:47 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 1G Sep 08 19:03:47 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:47 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 1G" returned: 0 in 0.441s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b53afab5-6514-42df-8393-b95083268a23 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:47 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b53afab5-6514-42df-8393-b95083268a23 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 Sep 08 19:03:47 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:47 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b53afab5-6514-42df-8393-b95083268a23 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71" returned: 0 in 0.312s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:47 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:47 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 Sep 08 19:03:47 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:48 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71" returned: 0 in 0.256s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:48 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.info Sep 08 19:03:48 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:48 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.info" returned: 0 in 0.253s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:48 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:48 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.info Sep 08 19:03:48 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:48 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.info" returned: 0 in 0.301s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.156s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Creating offline snapshot 8445080b-b9bf-467a-b797-0ea3b06b4303 of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab97178-e63c-4ee9-ad2f-ec7c398aba73]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:49 devstack sudo[92349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:49 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-fd1ae8b4-95c7-4050-9ac0-68f6a5459533 tempest-GroupSnapshotsTest-450460635 None] group_snapshot 9c74b244-26fb-4f92-ad20-796577006f55: created successfully Sep 08 19:03:49 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.464s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:49 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 1G Sep 08 19:03:49 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:49 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 1G" returned: 0 in 0.460s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:49 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 Sep 08 19:03:49 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] group_snapshot 9c74b244-26fb-4f92-ad20-796577006f55: deleting Sep 08 19:03:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] group_snapshot 9c74b244-26fb-4f92-ad20-796577006f55: deleting {{(pid=87538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-972f380e-129f-47ce-9745-3e3fc6f5ebe1" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-972f380e-129f-47ce-9745-3e3fc6f5ebe1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Deleting offline snapshot 972f380e-129f-47ce-9745-3e3fc6f5ebe1 of volume 8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] snapshot_file for this snap is: volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93671ff-f405-4068-9034-84db58ea51fe]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:50 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303" returned: 0 in 0.356s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:50 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 is being set with open permissions: ugo+rw Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:50 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 Sep 08 19:03:50 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:50 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 Sep 08 19:03:50 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:50 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303" returned: 0 in 0.261s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.676s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-8f1005c8-5de9-40b5-9170-8bde8ab201e7 req-e6a5e71a-c220-417d-924d-8616db62d3d8 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.972s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-8f1005c8-5de9-40b5-9170-8bde8ab201e7 req-e6a5e71a-c220-417d-924d-8616db62d3d8 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:50 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0d57daab-18ae-46d6-b83a-6c88fefcce2e tempest-SnapshotsActionsTest-2091053524 None] Create snapshot completed successfully Sep 08 19:03:50 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1" returned: 0 in 0.460s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-8f1005c8-5de9-40b5-9170-8bde8ab201e7 req-e6a5e71a-c220-417d-924d-8616db62d3d8 tempest-ServerActionsTestOtherA-151525973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea7ed516-ea25-4235-b203-657503a8377a', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbe481e-3b86-45b1-9b7d-b3d6f84b5f7e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:50 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-8f1005c8-5de9-40b5-9170-8bde8ab201e7 req-e6a5e71a-c220-417d-924d-8616db62d3d8 tempest-ServerActionsTestOtherA-151525973 None] attachment_update completed successfully. Sep 08 19:03:50 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 Sep 08 19:03:50 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-8445080b-b9bf-467a-b797-0ea3b06b4303-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:51 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" returned: 0 in 0.520s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-8445080b-b9bf-467a-b797-0ea3b06b4303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:51 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 Sep 08 19:03:51 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-8445080b-b9bf-467a-b797-0ea3b06b4303" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-8445080b-b9bf-467a-b797-0ea3b06b4303" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Deleting offline snapshot 8445080b-b9bf-467a-b797-0ea3b06b4303 of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] snapshot_file for this snap is: volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ce04e-324b-4079-b6fe-8a2a5411852e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:51 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 Sep 08 19:03:51 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:51 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1" returned: 0 in 0.482s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:51 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1 Sep 08 19:03:51 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:51 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303" returned: 0 in 0.529s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5892c06-a37a-46aa-802c-4202f1996f5d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:51 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9.972f380e-129f-47ce-9745-3e3fc6f5ebe1" returned: 0 in 0.315s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:51 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:51 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-972f380e-129f-47ce-9745-3e3fc6f5ebe1" released by "_delete_snapshot" :: held 1.903s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" released by "delete_snapshot" :: held 1.947s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-b53afab5-6514-42df-8393-b95083268a23" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-b53afab5-6514-42df-8393-b95083268a23" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-cf47ab69-7064-4184-95b4-17fb51aa1e71" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-cf47ab69-7064-4184-95b4-17fb51aa1e71" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Deleting offline snapshot cf47ab69-7064-4184-95b4-17fb51aa1e71 of volume b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] snapshot_file for this snap is: volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c044a90-89c6-4821-87c6-d8f8a6a5f85a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:52 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:52 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 Sep 08 19:03:52 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.422s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:52 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 Sep 08 19:03:52 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:52 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71" returned: 0 in 0.466s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b53afab5-6514-42df-8393-b95083268a23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7dbd64-8e68-49b7-990a-22bedc65f5ea]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:52 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303" returned: 0 in 0.457s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:52 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 Sep 08 19:03:52 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:52 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303 Sep 08 19:03:52 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:53 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.8445080b-b9bf-467a-b797-0ea3b06b4303" returned: 0 in 0.449s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-8445080b-b9bf-467a-b797-0ea3b06b4303" released by "_delete_snapshot" :: held 1.993s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:53 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" released by "delete_snapshot" :: held 2.027s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23" returned: 0 in 0.633s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:53 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 Sep 08 19:03:53 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Created reservations ['a168fb25-b73a-44d8-8632-a0a6312084e8', 'ba978754-0e86-4d19-a889-e30b9d9e61c0', 'f0703400-848c-4fdd-bf2d-70000002ff75', 'c0783816-f287-4026-8d2f-646fe4486084'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Delete snapshot completed successfully. Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e9a5268e-9d02-4e90-baa6-4ec47b88a035 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-8445080b-b9bf-467a-b797-0ea3b06b4303-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:53 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71" returned: 0 in 0.434s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:53 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71 Sep 08 19:03:53 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-5dd86a93-534b-41f3-952e-cb09a9a5883d req-7d66da8d-ea22-479b-8937-5b23062b4851 tempest-ServerActionsTestOtherA-151525973 None] Terminate volume connection completed successfully. Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-5dd86a93-534b-41f3-952e-cb09a9a5883d req-7d66da8d-ea22-479b-8937-5b23062b4851 tempest-ServerActionsTestOtherA-151525973 None] Deleting attachment ea7ed516-ea25-4235-b203-657503a8377a. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:03:53 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23.cf47ab69-7064-4184-95b4-17fb51aa1e71" returned: 0 in 0.282s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-cf47ab69-7064-4184-95b4-17fb51aa1e71" released by "_delete_snapshot" :: held 1.949s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-b53afab5-6514-42df-8393-b95083268a23" released by "delete_snapshot" :: held 1.979s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:54 devstack cinder-volume[87538]: WARNING cinder.quota [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-253604583 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-253604583, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:54 devstack cinder-volume[87538]: WARNING cinder.quota [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-253604583 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-253604583, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:54 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Created reservations ['775797e2-cde4-4ba3-a5fc-b5c08c60904c', 'c074f460-22c9-45ad-a7be-d4909452eb30', 'c80054d3-812f-475a-86ba-c70673081581', '6e730367-dec4-4699-b52a-bdd18b08c8cf'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:54 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] Created reservations ['088189f0-b8b5-4c96-adde-96e0909eb99e', '77161340-a080-439c-bedf-798b967e80ef', '396a79e3-22ca-4abf-b69b-b79da255779b', 'de90252f-581b-4669-b3c6-ab7b984015e1'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:54 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5da310a3-270c-4394-bfb1-d0998d3ceaf1 tempest-GroupSnapshotsTest-450460635 None] group_snapshot 9c74b244-26fb-4f92-ad20-796577006f55: deleted successfully Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Creating offline snapshot 003e48db-28dc-4824-b811-1d8bf2bb5bde of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fec2f9-7025-44a3-9d9e-f08b0388dd77]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-5dd86a93-534b-41f3-952e-cb09a9a5883d req-4ffd2be6-5039-40a8-84ae-ffa4db9978f1 tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:55 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:55 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:55 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:55 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde 1G Sep 08 19:03:55 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:56 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde 1G" returned: 0 in 0.523s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:56 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde Sep 08 19:03:56 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b00198-73a0-435e-8598-7f9da6b1ac42]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:56 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 Sep 08 19:03:56 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:56 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde" returned: 0 in 0.360s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:56 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde is being set with open permissions: ugo+rw Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:56 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde Sep 08 19:03:56 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:56 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:56 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9 Sep 08 19:03:56 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:56 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde" returned: 0 in 0.257s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.668s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-5dd86a93-534b-41f3-952e-cb09a9a5883d req-4ffd2be6-5039-40a8-84ae-ffa4db9978f1 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.552s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-5dd86a93-534b-41f3-952e-cb09a9a5883d req-4ffd2be6-5039-40a8-84ae-ffa4db9978f1 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6638a0f1-d42c-4a4d-a228-05e01e94f05b tempest-SnapshotsActionsTest-2091053524 None] Create snapshot completed successfully Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-5dd86a93-534b-41f3-952e-cb09a9a5883d req-4ffd2be6-5039-40a8-84ae-ffa4db9978f1 tempest-ServerActionsTestOtherA-151525973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd451a03b-a457-4ee4-9ec1-82ca111f05ca', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:03:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-5dd86a93-534b-41f3-952e-cb09a9a5883d req-4ffd2be6-5039-40a8-84ae-ffa4db9978f1 tempest-ServerActionsTestOtherA-151525973 None] attachment_update completed successfully. Sep 08 19:03:56 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-8e1e3545-acd2-4ffa-881b-efa12d32b8d9" released by "delete_volume" :: held 0.769s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-b53afab5-6514-42df-8393-b95083268a23" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-b53afab5-6514-42df-8393-b95083268a23" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[999cee30-6e95-48d7-863d-d5e9fdbc8b43]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:57 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 Sep 08 19:03:57 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-003e48db-28dc-4824-b811-1d8bf2bb5bde-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-003e48db-28dc-4824-b811-1d8bf2bb5bde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:57 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23" returned: 0 in 0.595s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:57 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23 Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-003e48db-28dc-4824-b811-1d8bf2bb5bde" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:03:57 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-003e48db-28dc-4824-b811-1d8bf2bb5bde" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Deleting offline snapshot 003e48db-28dc-4824-b811-1d8bf2bb5bde of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] snapshot_file for this snap is: volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb094a5-30d3-4db8-9f4a-6a277b41157b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:57 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde Sep 08 19:03:57 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:57 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b53afab5-6514-42df-8393-b95083268a23" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-b53afab5-6514-42df-8393-b95083268a23" released by "delete_volume" :: held 1.066s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Created reservations ['7f622460-8dd5-43cf-94db-77172a5c9991'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:58 devstack cinder-volume[87538]: WARNING cinder.quota [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-253604583 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-253604583, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Created reservations ['463b8b4e-3912-4fde-a4e3-466f9f4ef697', 'd5eef7f5-a38b-4704-be9d-7c9c4786bd56', '97d3e7df-dc50-4571-96e7-8689e985eef0', '8b812592-eb84-4336-929f-7768e23548d6'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:58 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde" returned: 0 in 0.487s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3d360-8b9a-4c6e-a014-7b64939e21e6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Created reservations ['a873943c-a393-4e03-bce2-4a4111d81734', 'ae7b17e7-02e2-4157-abc3-de601a99cc56', 'd476cff4-30be-4701-8353-a852cd2bf432', 'e89ccf65-8518-4d28-84df-557a8153cfca'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:03:58 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:03:58 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:03:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:58 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:03:58 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:59 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.764s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:03:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:59 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.515s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:59 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:03:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ae6d9872-11e5-49e6-868d-33bc00f6e374 tempest-GroupSnapshotsTest-450460635 None] Delete group completed successfully. Sep 08 19:03:59 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde Sep 08 19:03:59 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:03:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8b5b7aae-1e0f-4c41-b04f-56458e0daffd tempest-GroupSnapshotsTest-450460635 None] Group tempest-GroupSnapshotsTest-Group-1522219955: creating Sep 08 19:03:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8b5b7aae-1e0f-4c41-b04f-56458e0daffd tempest-GroupSnapshotsTest-450460635 None] Group tempest-GroupSnapshotsTest-Group-1522219955: created successfully Sep 08 19:03:59 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 08 19:03:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8b5b7aae-1e0f-4c41-b04f-56458e0daffd tempest-GroupSnapshotsTest-450460635 None] Create group completed successfully. Sep 08 19:03:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde" returned: 0 in 0.890s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:03:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:03:59 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde Sep 08 19:03:59 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:00 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.003e48db-28dc-4824-b811-1d8bf2bb5bde" returned: 0 in 0.333s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-003e48db-28dc-4824-b811-1d8bf2bb5bde" released by "_delete_snapshot" :: held 2.595s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" released by "delete_snapshot" :: held 2.637s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Created reservations ['e233aafb-5b9e-46cc-94d9-9c2638a915cd', '955ddeee-854b-436d-b9d5-26ae95bc641b', 'e7bc1dd5-7819-464a-a4fe-97306f9f14c4', 'c3d0c91f-503e-4398-b17b-d391f8727099'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Delete snapshot completed successfully. Sep 08 19:04:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d56e9fa-693d-411c-8ab3-fd407c972ca8 tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-003e48db-28dc-4824-b811-1d8bf2bb5bde-delete_snapshot" released by "delete_snapshot" :: held 2.828s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Creating offline snapshot c678c23b-a0a6-42c6-9137-2cdda5dc18d9 of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cf8bef-bc94-405f-867e-db62b6fc95cd]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:01 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:04:01 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (76eb8502-d318-4f41-8779-9bb3754ddf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06d189a-2bc3-4dbe-97d0-7b8aa04c7190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06d189a-2bc3-4dbe-97d0-7b8aa04c7190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186098644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35b25dfe-e87f-4fca-ba78-b7f2e3db0357,host='devstack@QuobyteHD#QuobyteHD',id=90285eb6-032b-4230-88e4-ad135696d792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:02Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e89e3002-2708-41c8-9a55-71fd88bd2bf9),volume_type_id=e89e3002-2708-41c8-9a55-71fd88bd2bf9)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8172546-3b0a-4716-adcf-fcae9a610070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8172546-3b0a-4716-adcf-fcae9a610070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153eb9b0-a8fb-42a4-b704-4cb750a089dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153eb9b0-a8fb-42a4-b704-4cb750a089dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90285eb6-032b-4230-88e4-ad135696d792', 'volume_name': 'volume-90285eb6-032b-4230-88e4-ad135696d792', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921b9f2f-b040-4f7d-8465-71b14fb71215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921b9f2f-b040-4f7d-8465-71b14fb71215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09ec22f-7de9-49b5-9b32-77f3ae16af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:01 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Volume 90285eb6-032b-4230-88e4-ad135696d792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90285eb6-032b-4230-88e4-ad135696d792', 'volume_size': 1} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:01 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.492s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:04:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:01 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 1G Sep 08 19:04:01 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:02 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 1G" returned: 0 in 0.507s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:02 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 Sep 08 19:04:02 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:02 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9" returned: 0 in 0.284s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:02 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 is being set with open permissions: ugo+rw Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:02 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 Sep 08 19:04:02 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:02 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9" returned: 0 in 0.253s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.658s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35b25dfe-e87f-4fca-ba78-b7f2e3db0357,created_at=2026-09-08T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186098644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35b25dfe-e87f-4fca-ba78-b7f2e3db0357,host='devstack@QuobyteHD#QuobyteHD',id=90285eb6-032b-4230-88e4-ad135696d792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f4af63752664bde9715b3a38dd2816b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:02Z,use_quota=True,user_id='fde263c6462548c4bc680c99437ad4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e89e3002-2708-41c8-9a55-71fd88bd2bf9),volume_type_id=e89e3002-2708-41c8-9a55-71fd88bd2bf9)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Creating volume 90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:04:02 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:04:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:02 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 1073741824 Sep 08 19:04:02 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c977d13a-b72b-46c9-8849-aaec6c85d3fc tempest-SnapshotsActionsTest-2091053524 None] Create snapshot completed successfully Sep 08 19:04:03 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 1073741824" returned: 0 in 0.455s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:03 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 Sep 08 19:04:03 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-c678c23b-a0a6-42c6-9137-2cdda5dc18d9-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-c678c23b-a0a6-42c6-9137-2cdda5dc18d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Acquiring lock "cinder-quobyte-c678c23b-a0a6-42c6-9137-2cdda5dc18d9" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-c678c23b-a0a6-42c6-9137-2cdda5dc18d9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Deleting offline snapshot c678c23b-a0a6-42c6-9137-2cdda5dc18d9 of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] snapshot_file for this snap is: volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c305d634-0c67-402b-82e6-7b13a96b7c87]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:03 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:03 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792" returned: 0 in 0.267s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:04:03 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09ec22f-7de9-49b5-9b32-77f3ae16af96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90285eb6-032b-4230-88e4-ad135696d792', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9080ee85-04fc-44fc-800b-203ce025dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:03 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Volume volume-90285eb6-032b-4230-88e4-ad135696d792 (90285eb6-032b-4230-88e4-ad135696d792): created successfully Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9080ee85-04fc-44fc-800b-203ce025dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Flow 'volume_create_manager' (76eb8502-d318-4f41-8779-9bb3754ddf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:03 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0b94156e-37fa-4136-9951-4a0c86338b9d tempest-GroupSnapshotsTest-450460635 None] Created volume successfully. Sep 08 19:04:03 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ae6d52-71eb-4339-9214-25e5b659faa6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:04 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:04:04 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] GroupSnapshot e8682f5c-42d3-406e-ab7a-3ff919e35146: creating. Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Group snapshot e8682f5c-42d3-406e-ab7a-3ff919e35146: creating. {{(pid=87538) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Creating offline snapshot ba4ef767-ecd8-45a9-a35d-a05b6505074c of volume 90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd61b0-9655-4b21-bd87-03e76bff00e8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:04 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.429s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:04 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 Sep 08 19:04:04 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:04 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 Sep 08 19:04:04 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:04 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792" returned: 0 in 0.381s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:04 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c 1G Sep 08 19:04:04 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:04 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9" returned: 0 in 0.387s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:04 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9 Sep 08 19:04:04 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:05 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.c678c23b-a0a6-42c6-9137-2cdda5dc18d9" returned: 0 in 0.281s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:05 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c 1G" returned: 0 in 0.423s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90285eb6-032b-4230-88e4-ad135696d792 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-c678c23b-a0a6-42c6-9137-2cdda5dc18d9" released by "_delete_snapshot" :: held 1.623s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" released by "delete_snapshot" :: held 1.648s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:05 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90285eb6-032b-4230-88e4-ad135696d792 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c Sep 08 19:04:05 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Created reservations ['ac23fcad-4575-4435-9aad-0ff537617a27', '0153aa3e-6db4-4701-b6cb-ecf8795ef60f', '957f41c7-84c5-476d-b68b-a9efbdae0e35', '6d2c78e3-e1f6-4d7e-9d44-2070baba72d5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Delete snapshot completed successfully. Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83b4256d-0951-48e2-a6c0-588c0367975a tempest-SnapshotsActionsTest-1013765699 None] Lock "cinder-c678c23b-a0a6-42c6-9137-2cdda5dc18d9-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:05 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90285eb6-032b-4230-88e4-ad135696d792 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c" returned: 0 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:05 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:05 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c Sep 08 19:04:05 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:05 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:05 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.info Sep 08 19:04:05 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:06 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "cinder-28cb6efc-5b92-4eaa-a1f4-86f273bd4c88-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.info" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:06 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:06 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.info Sep 08 19:04:06 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-28cb6efc-5b92-4eaa-a1f4-86f273bd4c88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "cinder-quobyte-28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-quobyte-28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Deleting offline snapshot 28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 of volume 92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] snapshot_file for this snap is: volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c2ef57-826d-4af3-9463-c2ecfa8a478a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:06 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:04:06 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:06 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.info" returned: 0 in 0.281s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:06 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7c437ab2-1835-4417-845c-c6cd2f5ec959 tempest-GroupSnapshotsTest-450460635 None] group_snapshot e8682f5c-42d3-406e-ab7a-3ff919e35146: created successfully Sep 08 19:04:06 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.402s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950c08-86cf-49c1-909c-adfacdd265d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcfc5ff-c497-4666-a237-f09c9d7f1ba4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:06 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 Sep 08 19:04:06 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:07 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:07 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:04:07 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:07 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.338s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:07 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88 Sep 08 19:04:07 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:07 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2.28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] group_snapshot e8682f5c-42d3-406e-ab7a-3ff919e35146: deleting Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-quobyte-28cb6efc-5b92-4eaa-a1f4-86f273bd4c88" released by "_delete_snapshot" :: held 1.580s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" released by "delete_snapshot" :: held 1.614s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] group_snapshot e8682f5c-42d3-406e-ab7a-3ff919e35146: deleting {{(pid=87538) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-90285eb6-032b-4230-88e4-ad135696d792" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-90285eb6-032b-4230-88e4-ad135696d792" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-ba4ef767-ecd8-45a9-a35d-a05b6505074c" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-ba4ef767-ecd8-45a9-a35d-a05b6505074c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Deleting offline snapshot ba4ef767-ecd8-45a9-a35d-a05b6505074c of volume 90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] snapshot_file for this snap is: volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Created reservations ['7ff4127e-9e67-4668-b08e-5c19bf3e32e6', 'e20d8ac7-32a8-4c5f-ab0c-a6792b11122b', '8da016e8-a5a6-41ea-8893-3b2213e9eb3d', 'd878330b-bf44-45a0-aa9d-a2d1fa2d4508'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cc7beb-96c5-4575-8d84-0564e28af813]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:08 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Delete snapshot completed successfully. Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7fc322b5-1379-4d68-84e9-20a6e1c0f0d8 tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-28cb6efc-5b92-4eaa-a1f4-86f273bd4c88-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:08 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c Sep 08 19:04:08 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "cinder-92950c08-86cf-49c1-909c-adfacdd265d2-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-92950c08-86cf-49c1-909c-adfacdd265d2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:08 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c" returned: 0 in 0.587s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90285eb6-032b-4230-88e4-ad135696d792(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6624352d-0b67-45b2-a450-bf8f3dd8cd02]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[167d8059-595b-4459-aefa-978b8052680f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:08 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 Sep 08 19:04:08 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:08 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 Sep 08 19:04:08 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:08 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2" returned: 0 in 0.409s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:09 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2 Sep 08 19:04:09 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:09 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792" returned: 0 in 0.520s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:09 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c Sep 08 19:04:09 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:09 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-92950c08-86cf-49c1-909c-adfacdd265d2" returned: 0 in 0.285s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-quobyte-92950c08-86cf-49c1-909c-adfacdd265d2" released by "delete_volume" :: held 0.782s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Created reservations ['0a607189-3a1c-4a4d-9baa-c1ec7a11d54e', 'c8d5f5c8-bb93-4988-84b7-ad21512d5333', 'a0c364e3-9fc8-4999-ab1d-40c289bae601', 'e2c2e7b9-6960-4276-ba13-bde826542a3d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:09 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:04:09 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:09 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c" returned: 0 in 0.398s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:09 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c Sep 08 19:04:09 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:09 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.290s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:04:09 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Deleted volume successfully. Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3758e2ae-a237-49b9-964a-af60a7a87efc tempest-SnapshotsActionsTest-2091053524 None] Lock "cinder-92950c08-86cf-49c1-909c-adfacdd265d2-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:09 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792.ba4ef767-ecd8-45a9-a35d-a05b6505074c" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-ba4ef767-ecd8-45a9-a35d-a05b6505074c" released by "_delete_snapshot" :: held 1.963s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-90285eb6-032b-4230-88e4-ad135696d792" released by "delete_snapshot" :: held 2.008s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:09 devstack cinder-volume[87538]: WARNING cinder.quota [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-92930237 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-92930237, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:04:09 devstack cinder-volume[87538]: WARNING cinder.quota [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-92930237 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-92930237, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:04:09 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] Created reservations ['77a30998-40e8-4a88-b3dc-f1d1442998e8', 'cb261691-eb3b-41d7-a2aa-24dd4dd4dbc9', 'f5837cbb-9704-4cd6-97ae-fe0beccb9bbb', 'e3ca495a-cc0b-4458-911d-6e31b127032e'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-725f38a0-36a9-48c9-93ed-75df6dcee86d tempest-GroupSnapshotsTest-450460635 None] group_snapshot e8682f5c-42d3-406e-ab7a-3ff919e35146: deleted successfully Sep 08 19:04:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "cinder-quobyte-90285eb6-032b-4230-88e4-ad135696d792" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-90285eb6-032b-4230-88e4-ad135696d792" acquired by "delete_volume" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c931776d-6113-4b6e-8ad9-f9466d3df2d8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:10 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 Sep 08 19:04:10 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-27690f28-7436-49fb-b323-c2c5ec151676 req-6b02cc7e-af20-45a5-bba5-9fa311f0b5d8 tempest-AttachVolumeTestJSON-720472429 None] Terminate volume connection completed successfully. Sep 08 19:04:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-27690f28-7436-49fb-b323-c2c5ec151676 req-6b02cc7e-af20-45a5-bba5-9fa311f0b5d8 tempest-AttachVolumeTestJSON-720472429 None] Deleting attachment 8a003ebb-c32b-44d2-8dff-8db5430d02a8. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:04:11 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792" returned: 0 in 0.433s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:11 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792 Sep 08 19:04:11 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:11 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90285eb6-032b-4230-88e4-ad135696d792" returned: 0 in 0.292s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Lock "cinder-quobyte-90285eb6-032b-4230-88e4-ad135696d792" released by "delete_volume" :: held 0.841s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Created reservations ['9eb70f33-99e8-4c72-ae54-eb099572049e'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:11 devstack cinder-volume[87538]: WARNING cinder.quota [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-92930237 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-92930237, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Created reservations ['da8fbb99-1f0e-46a8-8eff-63ebab74cc66', 'b14c0de3-3e68-4f9e-8987-6538efb56585', '438fd0b3-bd15-4776-b40d-5ee202391beb', '3042824d-44d5-4b7b-9b19-4107e7a6ba8d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:11 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:04:11 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:12 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.578s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:12 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:04:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-34cee594-4c17-40c3-9abe-eefc11148fbf tempest-GroupSnapshotsTest-450460635 None] Delete group completed successfully. Sep 08 19:04:21 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=152,cinder:INSERT=40,cinder:UPDATE=150,cinder:DELETE=5 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:04:21 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=150,cinder:SELECT=179,cinder:INSERT=34,cinder:DELETE=6 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:04:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-f4718168-c5be-4116-9c8f-9cb862093bbe req-2bd888dd-d6af-40eb-b31f-a85ad4f72b86 tempest-ServerActionsTestOtherA-151525973 None] Terminate volume connection completed successfully. Sep 08 19:04:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-f4718168-c5be-4116-9c8f-9cb862093bbe req-2bd888dd-d6af-40eb-b31f-a85ad4f72b86 tempest-ServerActionsTestOtherA-151525973 None] Deleting attachment d451a03b-a457-4ee4-9ec1-82ca111f05ca. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Flow 'volume_create_manager' (24e7eec3-4231-4879-933f-3a3437c3f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9082da36-43a0-46a2-81f3-f435ced27371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9082da36-43a0-46a2-81f3-f435ced27371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1392545759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8278d5362a2b4bf3acd2aa21f1418a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:27Z,use_quota=True,user_id='8232c8fa242e47ada5f004f8edb4c498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d5f6d7-2a51-4313-a5da-48a377ed86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d5f6d7-2a51-4313-a5da-48a377ed86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fbd9e1-9452-40fb-84e7-4c2ee498a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fbd9e1-9452-40fb-84e7-4c2ee498a22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4', 'volume_name': 'volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464d830e-689c-41ba-b3e5-b400cb265617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464d830e-689c-41ba-b3e5-b400cb265617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bd6bc8-5b13-4c82-905e-b5457949dbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Volume c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4', 'volume_size': 1} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1392545759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8278d5362a2b4bf3acd2aa21f1418a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:27Z,use_quota=True,user_id='8232c8fa242e47ada5f004f8edb4c498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Creating volume c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:04:27 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:04:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:27 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 1073741824 Sep 08 19:04:27 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:28 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 1073741824" returned: 0 in 0.820s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:28 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 Sep 08 19:04:28 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:28 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4" returned: 0 in 0.402s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bd6bc8-5b13-4c82-905e-b5457949dbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8164c7a-c1da-41c2-876a-97701488a9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Volume volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 (c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4): created successfully Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8164c7a-c1da-41c2-876a-97701488a9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Flow 'volume_create_manager' (24e7eec3-4231-4879-933f-3a3437c3f33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a2e451eb-ba7f-4bf5-be8f-76f2029d3139 tempest-VolumesServicesTestJSON-1810453858 None] Created volume successfully. Sep 08 19:04:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Acquiring lock "cinder-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Lock "cinder-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ae7f59e6-49bd-47af-b70e-31cf0f9b40e0 tempest-GroupsTest-1594759639 None] Group tempest-Group1-1145653805: creating Sep 08 19:04:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Acquiring lock "cinder-quobyte-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ae7f59e6-49bd-47af-b70e-31cf0f9b40e0 tempest-GroupsTest-1594759639 None] Group tempest-Group1-1145653805: created successfully Sep 08 19:04:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Lock "cinder-quobyte-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ae7f59e6-49bd-47af-b70e-31cf0f9b40e0 tempest-GroupsTest-1594759639 None] Create group completed successfully. Sep 08 19:04:29 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc39702-eb04-47c2-a30b-5c092a17cd18]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:29 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 Sep 08 19:04:29 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:30 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:30 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4 Sep 08 19:04:30 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:30 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4" returned: 0 in 0.354s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Lock "cinder-quobyte-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4" released by "delete_volume" :: held 0.825s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Created reservations ['6714f887-3c64-4426-a5b3-8a81f47ef111', 'f1e4b4f6-48ea-4be6-9772-d04c8168e066', 'e6970abf-6fe0-4515-91da-939b084c5d57', '70800c68-cd57-441e-8aa8-1635631b4358'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:30 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:04:30 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0f67aafc-3a0c-43b5-861e-0c3635d70841 tempest-GroupsTest-1594759639 None] Group tempest-Group2-1182005587: creating Sep 08 19:04:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0f67aafc-3a0c-43b5-861e-0c3635d70841 tempest-GroupsTest-1594759639 None] Group tempest-Group2-1182005587: created successfully Sep 08 19:04:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0f67aafc-3a0c-43b5-861e-0c3635d70841 tempest-GroupsTest-1594759639 None] Create group completed successfully. Sep 08 19:04:31 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.354s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:31 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:04:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Deleted volume successfully. Sep 08 19:04:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-76f493d2-2bb5-4882-b0a5-3e631a7a353b tempest-VolumesServicesTestJSON-1810453858 None] Lock "cinder-c3fc3162-3ecf-4a8f-aa14-b30606fcb7a4-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Flow 'volume_create_manager' (f99ecf37-80f8-42e4-91b3-da6476fc958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2afecd8-b66b-4510-8b7a-71e7ec6219af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2afecd8-b66b-4510-8b7a-71e7ec6219af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182024378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a546c6e5-eb27-4cce-96a8-7ba8f76b4097,host='devstack@QuobyteHD#QuobyteHD',id=bd1b31a8-2550-4929-9157-7b69b3a24e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49d23a067714b7b882f5b15dc1c5ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:33Z,use_quota=True,user_id='9515850e3c904f93be8dad083a5f8e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d4e6662-bd83-4617-a875-9e4ace175f13),volume_type_id=6d4e6662-bd83-4617-a875-9e4ace175f13)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd1e71b-b6da-4051-95ea-ad846c0b3444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd1e71b-b6da-4051-95ea-ad846c0b3444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3afeb5f-3180-4a91-960b-6ecb43c40174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3afeb5f-3180-4a91-960b-6ecb43c40174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1b31a8-2550-4929-9157-7b69b3a24e11', 'volume_name': 'volume-bd1b31a8-2550-4929-9157-7b69b3a24e11', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a6620e-8823-4486-8f54-8aaef001fa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a6620e-8823-4486-8f54-8aaef001fa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7129ee5-8d45-4671-8762-91cfa47752d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:32 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Volume bd1b31a8-2550-4929-9157-7b69b3a24e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1b31a8-2550-4929-9157-7b69b3a24e11', 'volume_size': 1} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a546c6e5-eb27-4cce-96a8-7ba8f76b4097,created_at=2026-09-08T17:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182024378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a546c6e5-eb27-4cce-96a8-7ba8f76b4097,host='devstack@QuobyteHD#QuobyteHD',id=bd1b31a8-2550-4929-9157-7b69b3a24e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49d23a067714b7b882f5b15dc1c5ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:33Z,use_quota=True,user_id='9515850e3c904f93be8dad083a5f8e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d4e6662-bd83-4617-a875-9e4ace175f13),volume_type_id=6d4e6662-bd83-4617-a875-9e4ace175f13)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Creating volume bd1b31a8-2550-4929-9157-7b69b3a24e11 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:04:32 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:04:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:32 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 1073741824 Sep 08 19:04:32 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Flow 'volume_create_manager' (3078e923-0fcf-4dbc-94f9-2e72f93aadee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8344caab-9fb9-498a-8688-192346d8a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8344caab-9fb9-498a-8688-192346d8a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-989799698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd7edea-70e6-435b-bba8-ff72e187cca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eb106d1cd049e1a214538ab1bd080d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:33Z,use_quota=True,user_id='39d2acdce07e4fbf9e085bed545aedf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3e8588-856d-4952-9cdd-96bf29decb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3e8588-856d-4952-9cdd-96bf29decb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d66593-a520-4dd7-b476-f85a33052d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:04:33 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 1073741824" returned: 0 in 0.519s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:33 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 Sep 08 19:04:33 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:33 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11" returned: 0 in 0.271s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7129ee5-8d45-4671-8762-91cfa47752d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1b31a8-2550-4929-9157-7b69b3a24e11', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c664eb8f-b8ba-4712-bfef-52c47151bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:33 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Volume volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 (bd1b31a8-2550-4929-9157-7b69b3a24e11): created successfully Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c664eb8f-b8ba-4712-bfef-52c47151bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Flow 'volume_create_manager' (f99ecf37-80f8-42e4-91b3-da6476fc958c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:33 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bf98f16c-744c-4fc4-ab11-1ca61d545694 tempest-GroupsTest-1594759639 None] Created volume successfully. Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d66593-a520-4dd7-b476-f85a33052d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9dd7edea-70e6-435b-bba8-ff72e187cca2', 'volume_name': 'volume-9dd7edea-70e6-435b-bba8-ff72e187cca2', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6ab01e-8461-448a-aae4-b6531ed29c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6ab01e-8461-448a-aae4-b6531ed29c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500af257-27a7-4b2b-9214-be8fc84175bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:33 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Volume 9dd7edea-70e6-435b-bba8-ff72e187cca2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9dd7edea-70e6-435b-bba8-ff72e187cca2', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:04:33 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Trying to clone 9dd7edea-70e6-435b-bba8-ff72e187cca2 from image 8499e13e-f314-4011-953c-7c51abb2061c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:04:34 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:34 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:04:34 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[527e844b-fbea-4581-861e-298b38bda0cc]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:34 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD Sep 08 19:04:34 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:34 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.334s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 28 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Acquiring lock "cinder-quobyte-bd1b31a8-2550-4929-9157-7b69b3a24e11" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Lock "cinder-quobyte-bd1b31a8-2550-4929-9157-7b69b3a24e11" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7298c433-f228-4891-8775-c7964567f099]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:34 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c is fetched for user 39d2acdce07e4fbf9e085bed545aedf4. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aaa7eb-598e-4aed-8883-41575f911a59]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:34 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 Sep 08 19:04:34 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:35 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD Sep 08 19:04:35 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:35 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11" returned: 0 in 0.422s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:35 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11 Sep 08 19:04:35 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:35 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-989799698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd7edea-70e6-435b-bba8-ff72e187cca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58eb106d1cd049e1a214538ab1bd080d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:33Z,use_quota=True,user_id='39d2acdce07e4fbf9e085bed545aedf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Creating volume 9dd7edea-70e6-435b-bba8-ff72e187cca2 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:04:35 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:35 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 1073741824 Sep 08 19:04:35 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:35 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd1b31a8-2550-4929-9157-7b69b3a24e11" returned: 0 in 0.271s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Lock "cinder-quobyte-bd1b31a8-2550-4929-9157-7b69b3a24e11" released by "delete_volume" :: held 0.752s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Created reservations ['14b814d2-8784-45d9-8640-bee3248b9fce'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:35 devstack cinder-volume[87538]: WARNING cinder.quota [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-669453857 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-669453857, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:04:35 devstack cinder-volume[87538]: WARNING cinder.quota [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-669453857 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-669453857, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Created reservations ['42e6fc10-a5e8-4e31-9d24-aae1edbe148d', '6fe35a59-3fa0-428e-a720-70ee482bcd6d', 'f2a6e855-0692-4e69-b887-0e2186dc36fd', '3662f4a7-e778-475b-a574-88247c1e06b2'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:35 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:04:35 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:35 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 1073741824" returned: 0 in 0.484s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:35 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 Sep 08 19:04:35 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:36 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.302s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:04:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2875eab7-8357-4d69-94ff-9f49ad370f20 tempest-GroupsTest-1594759639 None] Delete group completed successfully. Sep 08 19:04:36 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2" returned: 0 in 0.301s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Attempting download of 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 9dd7edea-70e6-435b-bba8-ff72e187cca2. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Created reservations ['a7b3e78d-9295-4f22-b320-ff2b178d7063'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6966fe-de19-4b1e-88b6-7d2ec8c46368]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_pgvow4py {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:36 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:04:36 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:36 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_pgvow4py Sep 08 19:04:36 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:36 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.280s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:04:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-696f275c-b3d0-4e6f-a6cc-6ba3629073df tempest-GroupsTest-1594759639 None] Delete group completed successfully. Sep 08 19:04:36 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_pgvow4py" returned: 0 in 0.371s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_pgvow4py {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:36 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_pgvow4py Sep 08 19:04:36 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:36 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_pgvow4py" returned: 1 in 0.336s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_pgvow4py' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9647f890-001a-40b6-a626-471ff3e6b98a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:37 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD Sep 08 19:04:37 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:37 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:37 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] 8499e13e-f314-4011-953c-7c51abb2061c was qcow2, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:04:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:37 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 Sep 08 19:04:37 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-fe455d74-fd6b-4ee0-9125-8077aa7f91a3 tempest-GroupsTest-1594759639 None] Group tempest-GroupsTest-Group-91646051: creating Sep 08 19:04:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-fe455d74-fd6b-4ee0-9125-8077aa7f91a3 tempest-GroupsTest-1594759639 None] Group tempest-GroupsTest-Group-91646051: created successfully Sep 08 19:04:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-fe455d74-fd6b-4ee0-9125-8077aa7f91a3 tempest-GroupsTest-1594759639 None] Create group completed successfully. Sep 08 19:04:39 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2" returned: 0 in 2.306s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c__4iv4fiddevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:04:39 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Converted 112.00 MB image at 48.56 MB/s Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:39 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 1G Sep 08 19:04:39 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Flow 'volume_create_manager' (f7940743-bf7a-4ada-86ef-d8d2ba462eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b2177d-d4de-4cf0-baec-75bc8d093abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b2177d-d4de-4cf0-baec-75bc8d093abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621082106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91fcd73b-807a-4fd3-8e2f-8651a746921d,host='devstack@QuobyteHD#QuobyteHD',id=9ae4f6bc-3a96-4e50-8cd6-31b906d598d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49d23a067714b7b882f5b15dc1c5ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:40Z,use_quota=True,user_id='9515850e3c904f93be8dad083a5f8e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac52636-7cd0-4f5e-982e-7520d1390426),volume_type_id=eac52636-7cd0-4f5e-982e-7520d1390426)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c49770f-4e6a-43fc-b6de-1f69baafb5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c49770f-4e6a-43fc-b6de-1f69baafb5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce01ba99-e9f9-49f1-a890-5f30f4089d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce01ba99-e9f9-49f1-a890-5f30f4089d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae4f6bc-3a96-4e50-8cd6-31b906d598d2', 'volume_name': 'volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed08380-f768-45be-9e1e-2583de307951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed08380-f768-45be-9e1e-2583de307951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b785a6-34ae-4971-bcaf-241c9d654abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:39 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Volume 9ae4f6bc-3a96-4e50-8cd6-31b906d598d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2', 'volume_size': 1} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91fcd73b-807a-4fd3-8e2f-8651a746921d,created_at=2026-09-08T17:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621082106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91fcd73b-807a-4fd3-8e2f-8651a746921d,host='devstack@QuobyteHD#QuobyteHD',id=9ae4f6bc-3a96-4e50-8cd6-31b906d598d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49d23a067714b7b882f5b15dc1c5ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:40Z,use_quota=True,user_id='9515850e3c904f93be8dad083a5f8e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac52636-7cd0-4f5e-982e-7520d1390426),volume_type_id=eac52636-7cd0-4f5e-982e-7520d1390426)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Creating volume 9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:04:39 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:39 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 1073741824 Sep 08 19:04:39 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:39 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 1G" returned: 0 in 0.382s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Downloaded image 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 9dd7edea-70e6-435b-bba8-ff72e187cca2 successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c for user 39d2acdce07e4fbf9e085bed545aedf4 is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Marking volume 9dd7edea-70e6-435b-bba8-ff72e187cca2 as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Copying metadata from image 8499e13e-f314-4011-953c-7c51abb2061c to 9dd7edea-70e6-435b-bba8-ff72e187cca2. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:04:39 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Creating volume glance metadata for volume 9dd7edea-70e6-435b-bba8-ff72e187cca2 backed by image 8499e13e-f314-4011-953c-7c51abb2061c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500af257-27a7-4b2b-9214-be8fc84175bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd7edea-70e6-435b-bba8-ff72e187cca2', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce82494d-5fed-4406-89ad-43963551032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Volume volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 (9dd7edea-70e6-435b-bba8-ff72e187cca2): created successfully Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce82494d-5fed-4406-89ad-43963551032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Flow 'volume_create_manager' (3078e923-0fcf-4dbc-94f9-2e72f93aadee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a991c8bb-5a19-4443-9502-09c4d3f5fa17 tempest-ServerActionsTestOtherA-151525973 None] Created volume successfully. Sep 08 19:04:40 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 1073741824" returned: 0 in 0.506s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:40 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 Sep 08 19:04:40 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:40 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b785a6-34ae-4971-bcaf-241c9d654abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a47059-b2a4-475b-921d-2c52664df911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Volume volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 (9ae4f6bc-3a96-4e50-8cd6-31b906d598d2): created successfully Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a47059-b2a4-475b-921d-2c52664df911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Flow 'volume_create_manager' (f7940743-bf7a-4ada-86ef-d8d2ba462eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9987fe8e-3929-4429-8532-532ba3d8549c tempest-GroupsTest-1594759639 None] Created volume successfully. Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Flow 'volume_create_manager' (c01d1a5b-b68b-44a7-b1c2-7627b0fc8334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea0c4a4-cea8-4145-82ba-2d231a7915ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea0c4a4-cea8-4145-82ba-2d231a7915ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571925354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91fcd73b-807a-4fd3-8e2f-8651a746921d,host='devstack@QuobyteHD#QuobyteHD',id=4529d0c4-c1ec-4732-a8ec-38ce57566619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49d23a067714b7b882f5b15dc1c5ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:42Z,use_quota=True,user_id='9515850e3c904f93be8dad083a5f8e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac52636-7cd0-4f5e-982e-7520d1390426),volume_type_id=eac52636-7cd0-4f5e-982e-7520d1390426)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c9f21e-d363-4cd4-ae8e-5b3d10b61905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c9f21e-d363-4cd4-ae8e-5b3d10b61905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821380a3-f3c4-4443-932d-6d607f3953e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821380a3-f3c4-4443-932d-6d607f3953e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4529d0c4-c1ec-4732-a8ec-38ce57566619', 'volume_name': 'volume-4529d0c4-c1ec-4732-a8ec-38ce57566619', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30412024-0096-4273-ae95-6bc7fc52127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30412024-0096-4273-ae95-6bc7fc52127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04655e18-1621-44c0-991a-adafbada9775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:41 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Volume 4529d0c4-c1ec-4732-a8ec-38ce57566619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4529d0c4-c1ec-4732-a8ec-38ce57566619', 'volume_size': 1} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91fcd73b-807a-4fd3-8e2f-8651a746921d,created_at=2026-09-08T17:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-571925354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91fcd73b-807a-4fd3-8e2f-8651a746921d,host='devstack@QuobyteHD#QuobyteHD',id=4529d0c4-c1ec-4732-a8ec-38ce57566619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f49d23a067714b7b882f5b15dc1c5ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:42Z,use_quota=True,user_id='9515850e3c904f93be8dad083a5f8e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eac52636-7cd0-4f5e-982e-7520d1390426),volume_type_id=eac52636-7cd0-4f5e-982e-7520d1390426)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Creating volume 4529d0c4-c1ec-4732-a8ec-38ce57566619 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:04:41 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:04:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:41 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 1073741824 Sep 08 19:04:41 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:42 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 1073741824" returned: 0 in 0.633s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:42 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 Sep 08 19:04:42 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:43 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619" returned: 0 in 0.466s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:04:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04655e18-1621-44c0-991a-adafbada9775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4529d0c4-c1ec-4732-a8ec-38ce57566619', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93c5dc3-1bb4-4f46-9cc7-b23077688991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:43 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Volume volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 (4529d0c4-c1ec-4732-a8ec-38ce57566619): created successfully Sep 08 19:04:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93c5dc3-1bb4-4f46-9cc7-b23077688991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Flow 'volume_create_manager' (c01d1a5b-b68b-44a7-b1c2-7627b0fc8334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-df4d6631-eb10-4419-a3fb-9e159b4f9fc1 tempest-GroupsTest-1594759639 None] Created volume successfully. Sep 08 19:04:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d368396a-eb85-4ecf-9854-db825cab84bf tempest-GroupsTest-1594759639 None] Update group completed successfully. Sep 08 19:04:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-fa8fecc8-aea1-4c58-9b6d-57c7ec7af567 req-657cf0f4-c33f-4aeb-bc66-ac6c5baea627 tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-fa8fecc8-aea1-4c58-9b6d-57c7ec7af567 req-657cf0f4-c33f-4aeb-bc66-ac6c5baea627 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-fa8fecc8-aea1-4c58-9b6d-57c7ec7af567 req-657cf0f4-c33f-4aeb-bc66-ac6c5baea627 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-fa8fecc8-aea1-4c58-9b6d-57c7ec7af567 req-657cf0f4-c33f-4aeb-bc66-ac6c5baea627 tempest-ServerActionsTestOtherA-151525973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-9dd7edea-70e6-435b-bba8-ff72e187cca2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecca8893-7b1e-4de7-a24f-f5fa48d192fc', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:04:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-fa8fecc8-aea1-4c58-9b6d-57c7ec7af567 req-657cf0f4-c33f-4aeb-bc66-ac6c5baea627 tempest-ServerActionsTestOtherA-151525973 None] attachment_update completed successfully. Sep 08 19:04:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e6680c66-dd75-4c20-a209-d1e63e868872 tempest-GroupsTest-1594759639 None] Update group completed successfully. Sep 08 19:04:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Acquiring lock "cinder-quobyte-4529d0c4-c1ec-4732-a8ec-38ce57566619" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Lock "cinder-quobyte-4529d0c4-c1ec-4732-a8ec-38ce57566619" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:48 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5eb0e0-8c7f-4215-acb7-45780eae03f2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:48 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 Sep 08 19:04:48 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:48 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619" returned: 0 in 0.694s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:48 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619 Sep 08 19:04:48 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:49 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4529d0c4-c1ec-4732-a8ec-38ce57566619" returned: 0 in 0.460s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Lock "cinder-quobyte-4529d0c4-c1ec-4732-a8ec-38ce57566619" released by "delete_volume" :: held 1.243s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Acquiring lock "cinder-quobyte-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Lock "cinder-quobyte-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5ac92b-2f00-426f-b0bc-a517bedb7560]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:49 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 Sep 08 19:04:49 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:49 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2" returned: 0 in 0.471s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:49 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2 Sep 08 19:04:49 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:50 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2" returned: 0 in 0.441s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Lock "cinder-quobyte-9ae4f6bc-3a96-4e50-8cd6-31b906d598d2" released by "delete_volume" :: held 1.042s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:04:50 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Created reservations ['b06f7cf9-1de0-489a-bfc2-4794d6bc659b'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:50 devstack cinder-volume[87538]: WARNING cinder.quota [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1884978879 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1884978879, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:04:50 devstack cinder-volume[87538]: WARNING cinder.quota [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1884978879 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1884978879, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:04:50 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Created reservations ['fa9005e1-6647-4791-885c-46ae6e803864', 'e34d0f1a-98df-4ca1-99d1-378d4023ac39', 'c06d299b-4f84-4b98-b668-8fde6bfd0b34', '817b9642-07a6-4656-b390-76580ea954fd'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Created reservations ['63944fbb-def0-40c3-aecf-cdfff82848b1', 'fcb81b1c-cb2d-47ac-bf08-c025bd62cd64', '29fe3974-c909-4c83-a60e-4a45dbb4a55e', 'f540c565-4e2d-4199-a478-68d8e0e0a0dc'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:51 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:04:51 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:51 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.361s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:51 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:04:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a5892c81-2aa3-47b3-97c7-3b446dc26da0 tempest-GroupsTest-1594759639 None] Delete group completed successfully. Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Flow 'volume_create_manager' (88f346b5-ceea-482c-83e0-9edab24cbc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8fd85f-d290-4492-a717-91e6dddf9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8fd85f-d290-4492-a717-91e6dddf9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1530568426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1d4170-5a6a-4efb-a0b5-10d0a7204926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9939b980a3b349cb850e709a3df13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:55Z,use_quota=True,user_id='35a8db5bef894c419e7b865ef3cd38ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b257ac4-fc2b-47d4-8f89-90d7794a584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b257ac4-fc2b-47d4-8f89-90d7794a584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2f8373-d6c0-48ab-b31a-643792e3c486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2f8373-d6c0-48ab-b31a-643792e3c486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b1d4170-5a6a-4efb-a0b5-10d0a7204926', 'volume_name': 'volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fed54a5-941a-434c-9167-12036b7ad132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fed54a5-941a-434c-9167-12036b7ad132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7811f816-d150-411c-bb85-3923b9f8bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:54 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Volume 2b1d4170-5a6a-4efb-a0b5-10d0a7204926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926', 'volume_size': 1} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1530568426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1d4170-5a6a-4efb-a0b5-10d0a7204926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9939b980a3b349cb850e709a3df13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:04:55Z,use_quota=True,user_id='35a8db5bef894c419e7b865ef3cd38ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Creating volume 2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:04:54 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:04:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:54 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 1073741824 Sep 08 19:04:54 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:55 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 1073741824" returned: 0 in 0.796s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:55 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 Sep 08 19:04:55 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:55 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:04:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:04:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7811f816-d150-411c-bb85-3923b9f8bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed6f432-06be-419c-8305-9146783da3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:04:56 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Volume volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 (2b1d4170-5a6a-4efb-a0b5-10d0a7204926): created successfully Sep 08 19:04:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed6f432-06be-419c-8305-9146783da3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:04:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Flow 'volume_create_manager' (88f346b5-ceea-482c-83e0-9edab24cbc48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:04:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-13cb43d1-6875-44f7-95f5-ad75577ec178 tempest-VolumesDeleteCascade-1692094429 None] Created volume successfully. Sep 08 19:04:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:04:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:04:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Creating offline snapshot aaf90fd6-cfc8-4b73-ab1a-8004b68d789f of volume 2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:04:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295f361-beb0-4043-9000-aa499eded852]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:04:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:57 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 Sep 08 19:04:57 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:57 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" returned: 0 in 0.533s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:57 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f 1G Sep 08 19:04:57 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:58 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f 1G" returned: 0 in 0.486s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:58 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f Sep 08 19:04:58 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:58 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" returned: 0 in 0.492s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:58 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f is being set with open permissions: ugo+rw Sep 08 19:04:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:58 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f Sep 08 19:04:58 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:59 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" returned: 0 in 0.660s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:59 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.info Sep 08 19:04:59 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:04:59 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Sep 08 19:04:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.info" returned: 0 in 0.524s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:04:59 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.info is being set with open permissions: ugo+rw Sep 08 19:04:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:04:59 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.info Sep 08 19:04:59 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:00 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.info" returned: 0 in 0.695s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9e400f1c-92ec-4eac-ba46-24b2e0cc2f62 tempest-VolumesDeleteCascade-1692094429 None] Create snapshot completed successfully Sep 08 19:05:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Creating offline snapshot 0be36108-9c0a-460b-a0f7-950df933c063 of volume 2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:05:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa26f9b8-61d7-4125-9fbc-e9810a735dca]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:02 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f Sep 08 19:05:02 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" returned: 0 in 0.809s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:03 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:03 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 1G Sep 08 19:05:03 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:04 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 1G" returned: 0 in 1.196s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:04 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 Sep 08 19:05:04 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:04 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063" returned: 0 in 0.494s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:04 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 is being set with open permissions: ugo+rw Sep 08 19:05:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:04 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 Sep 08 19:05:04 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:05 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063" returned: 0 in 0.505s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.354s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-036c067b-c24c-47c7-b1bf-e08cf6189182 tempest-VolumesDeleteCascade-1692094429 None] Create snapshot completed successfully Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-2b1d4170-5a6a-4efb-a0b5-10d0a7204926-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-2b1d4170-5a6a-4efb-a0b5-10d0a7204926-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Performing cascade delete. {{(pid=87538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-0be36108-9c0a-460b-a0f7-950df933c063-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-0be36108-9c0a-460b-a0f7-950df933c063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-0be36108-9c0a-460b-a0f7-950df933c063" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-0be36108-9c0a-460b-a0f7-950df933c063" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Deleting offline snapshot 0be36108-9c0a-460b-a0f7-950df933c063 of volume 2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] snapshot_file for this snap is: volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93d47b2-1d45-4e78-9de3-f57c5947ac81]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:07 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 Sep 08 19:05:07 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-983ca366-f06a-4552-a2b4-d119c2d809a0 tempest-GroupsV314Test-1583354671 None] Group tempest-GroupsV314Test-Group-307476907: creating Sep 08 19:05:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-983ca366-f06a-4552-a2b4-d119c2d809a0 tempest-GroupsV314Test-1583354671 None] Group tempest-GroupsV314Test-Group-307476907: created successfully Sep 08 19:05:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-983ca366-f06a-4552-a2b4-d119c2d809a0 tempest-GroupsV314Test-1583354671 None] Create group completed successfully. Sep 08 19:05:07 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063" returned: 0 in 0.768s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[794dfab7-c418-4360-9042-b4a258598e0a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:08 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f Sep 08 19:05:08 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:08 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" returned: 0 in 0.697s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:08 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 Sep 08 19:05:08 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Flow 'volume_create_manager' (015a2dc7-a63e-4605-b539-975ee79a1caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f17a55-bef4-433b-8473-c1a662720948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f17a55-bef4-433b-8473-c1a662720948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1059220670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=078d1dd9-8d65-4e60-a924-ffb4ac0d3174,host='devstack@QuobyteHD#QuobyteHD',id=895eed65-e84c-40bb-8fec-1c4846a30fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c420e4fab34c0ea27610e5b1f4ccfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:09Z,use_quota=True,user_id='c5445ed62ed04f7e9046e5a4b9e3b5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7796c02-c4f9-4dc8-b6bf-669048d3a2d8),volume_type_id=d7796c02-c4f9-4dc8-b6bf-669048d3a2d8)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3613d1f5-b2fb-412d-bad4-9f55391fc7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3613d1f5-b2fb-412d-bad4-9f55391fc7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9120d140-6821-4e3d-b10b-2cb2c2f30818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9120d140-6821-4e3d-b10b-2cb2c2f30818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895eed65-e84c-40bb-8fec-1c4846a30fe0', 'volume_name': 'volume-895eed65-e84c-40bb-8fec-1c4846a30fe0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904d5288-d5e5-4db8-ae2c-fa1e4505a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904d5288-d5e5-4db8-ae2c-fa1e4505a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdb7ead-75f2-4d25-b2bb-5f20c6ee97d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:09 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Volume 895eed65-e84c-40bb-8fec-1c4846a30fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895eed65-e84c-40bb-8fec-1c4846a30fe0', 'volume_size': 1} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=078d1dd9-8d65-4e60-a924-ffb4ac0d3174,created_at=2026-09-08T17:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1059220670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=078d1dd9-8d65-4e60-a924-ffb4ac0d3174,host='devstack@QuobyteHD#QuobyteHD',id=895eed65-e84c-40bb-8fec-1c4846a30fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c420e4fab34c0ea27610e5b1f4ccfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:09Z,use_quota=True,user_id='c5445ed62ed04f7e9046e5a4b9e3b5c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7796c02-c4f9-4dc8-b6bf-669048d3a2d8),volume_type_id=d7796c02-c4f9-4dc8-b6bf-669048d3a2d8)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Creating volume 895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:05:09 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:09 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063" returned: 0 in 0.808s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:09 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 1073741824 Sep 08 19:05:09 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:09 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063 Sep 08 19:05:09 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:10 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 1073741824" returned: 0 in 0.704s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:10 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.0be36108-9c0a-460b-a0f7-950df933c063" returned: 0 in 0.705s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-3543b651-b382-442a-984d-3d9969c19e00 req-65839211-c21e-4a02-b264-98d9f6f37781 tempest-ServerActionsTestOtherA-151525973 None] Terminate volume connection completed successfully. Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-3543b651-b382-442a-984d-3d9969c19e00 req-65839211-c21e-4a02-b264-98d9f6f37781 tempest-ServerActionsTestOtherA-151525973 None] Deleting attachment ecca8893-7b1e-4de7-a24f-f5fa48d192fc. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-0be36108-9c0a-460b-a0f7-950df933c063" released by "_delete_snapshot" :: held 3.254s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" released by "delete_snapshot" :: held 3.347s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:10 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 Sep 08 19:05:10 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Created reservations ['b943ed22-c25f-4c66-9d64-f9c590c3f5a6', '973998ce-7e63-4cdd-a250-b53d85a5d165', 'fb9cc39e-3fdf-438d-b475-1002171dbb17', 'df886a5f-80a6-4605-8213-f4a5e556b856'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Delete snapshot completed successfully. Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-0be36108-9c0a-460b-a0f7-950df933c063-delete_snapshot" released by "delete_snapshot" :: held 3.723s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-aaf90fd6-cfc8-4b73-ab1a-8004b68d789f-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-aaf90fd6-cfc8-4b73-ab1a-8004b68d789f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:10 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0" returned: 0 in 0.468s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdb7ead-75f2-4d25-b2bb-5f20c6ee97d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895eed65-e84c-40bb-8fec-1c4846a30fe0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976f19b8-0d31-439b-b772-e0e894dcbf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" acquired by "_delete_snapshot" :: waited 0.079s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Deleting offline snapshot aaf90fd6-cfc8-4b73-ab1a-8004b68d789f of volume 2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] snapshot_file for this snap is: volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:05:10 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Volume volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 (895eed65-e84c-40bb-8fec-1c4846a30fe0): created successfully Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976f19b8-0d31-439b-b772-e0e894dcbf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Flow 'volume_create_manager' (015a2dc7-a63e-4605-b539-975ee79a1caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b11876-47a2-41ba-a02f-4cc79ce19b20]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-491b14a5-364e-492c-b1c0-28bea91841b5 tempest-GroupsV314Test-1583354671 None] Created volume successfully. Sep 08 19:05:11 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f Sep 08 19:05:11 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:11 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" returned: 0 in 0.451s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:11 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183e5b3-ecd9-47a7-a386-f1b497097634]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:11 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 Sep 08 19:05:11 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:11 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" returned: 0 in 0.400s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:11 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f Sep 08 19:05:11 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:12 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" returned: 0 in 0.521s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:12 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f Sep 08 19:05:12 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3543b651-b382-442a-984d-3d9969c19e00 req-b46e83af-ad66-425d-a2f5-751d110c6c89 tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3543b651-b382-442a-984d-3d9969c19e00 req-b46e83af-ad66-425d-a2f5-751d110c6c89 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:12 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926.aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" returned: 0 in 0.413s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3543b651-b382-442a-984d-3d9969c19e00 req-b46e83af-ad66-425d-a2f5-751d110c6c89 tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-aaf90fd6-cfc8-4b73-ab1a-8004b68d789f" released by "_delete_snapshot" :: held 1.952s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" released by "delete_snapshot" :: held 2.046s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-3543b651-b382-442a-984d-3d9969c19e00 req-b46e83af-ad66-425d-a2f5-751d110c6c89 tempest-ServerActionsTestOtherA-151525973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-9dd7edea-70e6-435b-bba8-ff72e187cca2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d017cff-328b-450f-9fda-32a1b4a8d0ad', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Created reservations ['366636f3-9f21-495e-b662-399b26195255', '1089207e-b740-425b-ae93-fc96d231463b', '8b692d34-412f-4a87-b591-bbe773ce652b', '7a197d1e-b531-4278-a01e-2f6c485c4d09'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-3543b651-b382-442a-984d-3d9969c19e00 req-b46e83af-ad66-425d-a2f5-751d110c6c89 tempest-ServerActionsTestOtherA-151525973 None] attachment_update completed successfully. Sep 08 19:05:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Delete snapshot completed successfully. Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-aaf90fd6-cfc8-4b73-ab1a-8004b68d789f-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Snapshots deleted, issuing volume delete {{(pid=87538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 19:05:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8945a37f-16e8-4439-a31b-cfc8126e5936]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:13 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Cloning volume 895eed65-e84c-40bb-8fec-1c4846a30fe0 to volume 76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Creating offline snapshot 4feca0cd-1429-42d9-8665-ec696b3956bf of volume 895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef44584-9e57-4f65-931c-81e83ae7a148]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:13 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 Sep 08 19:05:13 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:13 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 Sep 08 19:05:13 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:14 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0" returned: 0 in 0.729s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:14 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" returned: 0 in 0.967s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:14 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf 1G Sep 08 19:05:14 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:14 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926 Sep 08 19:05:14 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:14 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" returned: 0 in 0.377s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-2b1d4170-5a6a-4efb-a0b5-10d0a7204926" released by "delete_volume" :: held 1.472s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Created reservations ['96cefc52-562d-441c-a0fe-af9d4bd6e3ea', '683ae654-0291-401c-be6f-471f97bda7d3', '9abf0d04-9789-4df9-899c-7a61b8d2154c', 'b7f80130-d332-4618-a62d-0e4c87b16879'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:14 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:14 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:14 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf 1G" returned: 0 in 0.919s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:15 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf Sep 08 19:05:15 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:15 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.565s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:15 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Deleted volume successfully. Sep 08 19:05:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-acf55522-6bcd-47dc-a9c4-df9e37e3c5b9 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-2b1d4170-5a6a-4efb-a0b5-10d0a7204926-delete_volume" released by "delete_volume" :: held 8.775s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:15 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf" returned: 0 in 0.534s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:15 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:05:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:15 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf Sep 08 19:05:15 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:15 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf" returned: 0 in 0.265s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:15 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.info Sep 08 19:05:15 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:16 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.info" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:16 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:16 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.info Sep 08 19:05:16 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:16 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.info" returned: 0 in 0.382s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Acquiring lock "cinder-quobyte-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] snapshot: 4feca0cd-1429-42d9-8665-ec696b3956bf, volume: 76b88ffb-dd45-4a70-a7ba-2040fb4b8d27, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae725f70-e255-4692-b5b4-bd9e00e4441f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:16 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf Sep 08 19:05:16 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:17 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Flow 'volume_create_manager' (f1063a62-1948-4aea-82d1-4d16eba4e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f3ab1-54ba-4978-a13d-771f2a0c57c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf" returned: 0 in 0.726s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-895eed65-e84c-40bb-8fec-1c4846a30fe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026f3ab1-54ba-4978-a13d-771f2a0c57c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-237876461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6942b66a-9b1c-43bc-97e4-902526242ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9939b980a3b349cb850e709a3df13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:17Z,use_quota=True,user_id='35a8db5bef894c419e7b865ef3cd38ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f395e-ca5e-4dc5-8d24-5faa8628984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56f395e-ca5e-4dc5-8d24-5faa8628984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2659f7-e168-4d47-9ad5-9d0b334f9c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2659f7-e168-4d47-9ad5-9d0b334f9c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6942b66a-9b1c-43bc-97e4-902526242ff5', 'volume_name': 'volume-6942b66a-9b1c-43bc-97e4-902526242ff5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442f3b8d-6779-4fda-abb2-9beb633d65b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442f3b8d-6779-4fda-abb2-9beb633d65b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7894934d-4c0a-4322-bd61-13a5bd0d3d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:17 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Volume 6942b66a-9b1c-43bc-97e4-902526242ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6942b66a-9b1c-43bc-97e4-902526242ff5', 'volume_size': 1} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08f957d-57c4-43b6-8d8b-4f4faf36486e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:17 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 Sep 08 19:05:17 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:17 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0" returned: 0 in 0.440s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:05:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:17 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 Sep 08 19:05:17 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:25 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" returned: 0 in 7.536s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:05:25 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Converted 1024.00 MB image at 135.82 MB/s Sep 08 19:05:25 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:25 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 Sep 08 19:05:25 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:25 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" returned: 0 in 0.441s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" released by "_copy_volume_from_snapshot" :: held 9.276s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=104,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Acquiring lock "cinder-quobyte-4feca0cd-1429-42d9-8665-ec696b3956bf" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-4feca0cd-1429-42d9-8665-ec696b3956bf" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Deleting offline snapshot 4feca0cd-1429-42d9-8665-ec696b3956bf of volume 895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] snapshot_file for this snap is: volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da8dc9e-4d0c-4e69-93ff-2a2076408905]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:26 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf Sep 08 19:05:26 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:26 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=109,cinder:UPDATE=95,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:05:26 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf" returned: 0 in 0.415s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-895eed65-e84c-40bb-8fec-1c4846a30fe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:26 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[50376267-a2e0-43e1-8e41-ab3b25bb7c16]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:26 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 Sep 08 19:05:26 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:27 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0" returned: 0 in 0.653s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:27 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf Sep 08 19:05:27 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:27 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf" returned: 0 in 0.336s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:27 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf Sep 08 19:05:27 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:27 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0.4feca0cd-1429-42d9-8665-ec696b3956bf" returned: 0 in 0.301s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-4feca0cd-1429-42d9-8665-ec696b3956bf" released by "_delete_snapshot" :: held 1.849s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.600s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.391s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-237876461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6942b66a-9b1c-43bc-97e4-902526242ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9939b980a3b349cb850e709a3df13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:17Z,use_quota=True,user_id='35a8db5bef894c419e7b865ef3cd38ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Creating volume 6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:05:27 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:27 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 1073741824 Sep 08 19:05:27 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:05:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Flow 'volume_create_manager' (3be7d1ac-eb31-459a-9d5f-50da7969cf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cd6ab3-d5f1-43f4-bea8-4a13ad78ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95cd6ab3-d5f1-43f4-bea8-4a13ad78ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1695320204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c36f2f9-2e60-4ce1-a795-c1b534c3213c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2606b6f1149d8b42b4dd3c1d6af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:28Z,use_quota=True,user_id='9bc1b0635c314911ade50fdccf38af9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7a0cd8-b120-4079-b378-26c65cc4e1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7a0cd8-b120-4079-b378-26c65cc4e1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39599a17-94aa-4d48-9e46-2215890c831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39599a17-94aa-4d48-9e46-2215890c831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c36f2f9-2e60-4ce1-a795-c1b534c3213c', 'volume_name': 'volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e76990-7219-4587-a4e8-d280a1ad1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e76990-7219-4587-a4e8-d280a1ad1605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6c919b-3e98-4cad-945d-c6af52755463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Volume 8c36f2f9-2e60-4ce1-a795-c1b534c3213c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c', 'volume_size': 1} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2f64f531-58b9-4a4a-84f8-d3abc39a2151 tempest-GroupsV314Test-1583354671 None] Create group from source-group-078d1dd9-8d65-4e60-a924-ffb4ac0d3174 completed successfully. Sep 08 19:05:28 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 1073741824" returned: 0 in 0.540s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:28 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 Sep 08 19:05:28 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Acquiring lock "cinder-quobyte-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" acquired by "delete_volume" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c03b2f-e0b2-45f5-a6f8-44f5d1fc9ebc]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:28 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5" returned: 0 in 0.294s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1695320204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c36f2f9-2e60-4ce1-a795-c1b534c3213c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2606b6f1149d8b42b4dd3c1d6af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:28Z,use_quota=True,user_id='9bc1b0635c314911ade50fdccf38af9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Creating volume 8c36f2f9-2e60-4ce1-a795-c1b534c3213c {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:05:28 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 Sep 08 19:05:28 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:28 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7894934d-4c0a-4322-bd61-13a5bd0d3d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6942b66a-9b1c-43bc-97e4-902526242ff5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:28 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c 1073741824 Sep 08 19:05:28 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c201f0-919f-4fda-b5ea-698272193a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Volume volume-6942b66a-9b1c-43bc-97e4-902526242ff5 (6942b66a-9b1c-43bc-97e4-902526242ff5): created successfully Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c201f0-919f-4fda-b5ea-698272193a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Flow 'volume_create_manager' (f1063a62-1948-4aea-82d1-4d16eba4e564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b52d7c53-0f3f-4159-b9ee-82d5cc76f47a tempest-VolumesDeleteCascade-1692094429 None] Created volume successfully. Sep 08 19:05:29 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" returned: 0 in 0.507s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:29 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27 Sep 08 19:05:29 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:29 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c 1073741824" returned: 0 in 0.584s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:29 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c Sep 08 19:05:29 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:29 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" returned: 0 in 0.327s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-76b88ffb-dd45-4a70-a7ba-2040fb4b8d27" released by "delete_volume" :: held 0.903s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Created reservations ['12ab11c4-0b04-4fe2-897c-5247bd79b1d4'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:29 devstack cinder-volume[87538]: WARNING cinder.quota [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-776493979 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-776493979, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:05:29 devstack cinder-volume[87538]: WARNING cinder.quota [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-776493979 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-776493979, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Created reservations ['b9e13230-c33b-42cb-babf-71d15e9fdd45', '669ffbae-5cd8-48e1-912b-3595fbdfa8ef', '2a34d284-d6fd-4215-b2eb-64cc3df0c8cf', 'e08622b8-002b-4c82-b0a6-ca1c5290dd02'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:29 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c" returned: 0 in 0.281s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.326s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6c919b-3e98-4cad-945d-c6af52755463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2a94f1-031b-4e76-af41-a2378474b737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:29 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Volume volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c (8c36f2f9-2e60-4ce1-a795-c1b534c3213c): created successfully Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2a94f1-031b-4e76-af41-a2378474b737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Flow 'volume_create_manager' (3be7d1ac-eb31-459a-9d5f-50da7969cf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Creating offline snapshot a34a0340-0045-494d-a1ba-5f9a0a0b9b90 of volume 6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:05:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-cc75d1ee-7a5e-4a6a-8109-a2cf7a285543 tempest-AttachVolumeTestJSON-720472429 None] Created volume successfully. Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470bf9a-fea4-4d6d-81c7-b3869a53e938]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:29 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:29 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:29 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 Sep 08 19:05:29 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:30 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:30 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:30 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-89c7aefd-4b1c-41ec-ac59-4c7becd755c6 tempest-GroupsV314Test-1583354671 None] Delete group completed successfully. Sep 08 19:05:30 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5" returned: 0 in 0.465s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:30 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 1G Sep 08 19:05:30 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:30 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 1G" returned: 0 in 0.561s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6942b66a-9b1c-43bc-97e4-902526242ff5 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:30 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6942b66a-9b1c-43bc-97e4-902526242ff5 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 Sep 08 19:05:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-41e923bc-fb36-4fe0-a8c3-4a848a73a0a5 req-353dfe6f-6ffd-4fd5-8e05-123d2cc62012 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:30 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Acquiring lock "cinder-quobyte-895eed65-e84c-40bb-8fec-1c4846a30fe0" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-895eed65-e84c-40bb-8fec-1c4846a30fe0" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31e472d-d8e2-4284-b231-1df6715840a7]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:31 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6942b66a-9b1c-43bc-97e4-902526242ff5 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90" returned: 0 in 0.355s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:31 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 is being set with open permissions: ugo+rw Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:31 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 Sep 08 19:05:31 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:31 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 Sep 08 19:05:31 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:31 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:31 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.info Sep 08 19:05:31 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:31 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0" returned: 0 in 0.413s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:31 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0 Sep 08 19:05:31 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:31 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.info" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:31 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.info is being set with open permissions: ugo+rw Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:31 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:31 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.info Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-895eed65-e84c-40bb-8fec-1c4846a30fe0" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:31 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Lock "cinder-quobyte-895eed65-e84c-40bb-8fec-1c4846a30fe0" released by "delete_volume" :: held 0.745s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Created reservations ['7a3ceef5-c6fa-44d8-a51e-c9006270e01c'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:31 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Created reservations ['04ae8947-fbd5-4971-92b3-496d80f39ab7', '53fe1e93-9098-4d45-a1b9-ab55c3959e83', '9ce3c175-ecd6-45a6-8f9b-1137b1179eb0', 'eb8f6682-d6e8-48be-8c0c-b8ae3f94e982'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:32 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.info" returned: 0 in 0.260s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-41e923bc-fb36-4fe0-a8c3-4a848a73a0a5 req-353dfe6f-6ffd-4fd5-8e05-123d2cc62012 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.226s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-41e923bc-fb36-4fe0-a8c3-4a848a73a0a5 req-353dfe6f-6ffd-4fd5-8e05-123d2cc62012 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7ff51b76-5f85-44ea-8724-2ee31b82d0b2 tempest-VolumesDeleteCascade-1692094429 None] Create snapshot completed successfully Sep 08 19:05:32 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:32 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-41e923bc-fb36-4fe0-a8c3-4a848a73a0a5 req-353dfe6f-6ffd-4fd5-8e05-123d2cc62012 tempest-AttachVolumeTestJSON-720472429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3e0c392-9fd1-47e4-a422-1218e84d03d4', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:05:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-41e923bc-fb36-4fe0-a8c3-4a848a73a0a5 req-353dfe6f-6ffd-4fd5-8e05-123d2cc62012 tempest-AttachVolumeTestJSON-720472429 None] attachment_update completed successfully. Sep 08 19:05:32 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.400s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:32 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1ab79389-a4d3-439d-bb70-59f744a9d5e2 tempest-GroupsV314Test-1583354671 None] Delete group completed successfully. Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Flow 'volume_create_manager' (75a349a5-900e-474b-884c-37d57220f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a358bb-c370-4806-adc1-cfa7ee931cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a358bb-c370-4806-adc1-cfa7ee931cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1218251532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1221d68-cd66-4717-9b96-da279c44c89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9939b980a3b349cb850e709a3df13f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a34a0340-0045-494d-a1ba-5f9a0a0b9b90,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:33Z,use_quota=True,user_id='35a8db5bef894c419e7b865ef3cd38ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3d31e3-a3b0-40b9-a664-eb587f343e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3d31e3-a3b0-40b9-a664-eb587f343e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b777733-d649-45a0-b70c-95ad188620d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b777733-d649-45a0-b70c-95ad188620d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1221d68-cd66-4717-9b96-da279c44c89d', 'volume_name': 'volume-c1221d68-cd66-4717-9b96-da279c44c89d', 'volume_size': 1, 'snapshot_id': 'a34a0340-0045-494d-a1ba-5f9a0a0b9b90'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ab9a5-65a8-4e74-9777-9f2fbde5d0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2ab9a5-65a8-4e74-9777-9f2fbde5d0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adc8fd3-eba0-46f5-85c2-2ac9c03b1d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:33 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Volume c1221d68-cd66-4717-9b96-da279c44c89d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1221d68-cd66-4717-9b96-da279c44c89d', 'volume_size': 1, 'snapshot_id': 'a34a0340-0045-494d-a1ba-5f9a0a0b9b90'} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-a34a0340-0045-494d-a1ba-5f9a0a0b9b90-c1221d68-cd66-4717-9b96-da279c44c89d" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-a34a0340-0045-494d-a1ba-5f9a0a0b9b90-c1221d68-cd66-4717-9b96-da279c44c89d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Creating volume c1221d68-cd66-4717-9b96-da279c44c89d from snapshot a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-c1221d68-cd66-4717-9b96-da279c44c89d" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-c1221d68-cd66-4717-9b96-da279c44c89d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] snapshot: a34a0340-0045-494d-a1ba-5f9a0a0b9b90, volume: c1221d68-cd66-4717-9b96-da279c44c89d, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e673f209-1571-4d90-be34-cea1088a9000]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:33 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 Sep 08 19:05:33 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:33 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6942b66a-9b1c-43bc-97e4-902526242ff5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dce127-f92a-459f-942b-ff0c6a37dd29]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:34 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 Sep 08 19:05:34 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:34 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:34 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:34 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5" returned: 0 in 0.576s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:34 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d Sep 08 19:05:34 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:34 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 28 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:05:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Flow 'volume_create_manager' (4d8424f8-6ca8-4ede-9b78-97bf05a0950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ed92cd-4dfd-4a57-b6d9-5f4130ba9334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ed92cd-4dfd-4a57-b6d9-5f4130ba9334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-137226713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647ac2ca-2a65-49eb-8350-9a6dbae6f757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2606b6f1149d8b42b4dd3c1d6af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:35Z,use_quota=True,user_id='9bc1b0635c314911ade50fdccf38af9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240e5c02-42b4-453f-9a46-4e7c064c9222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240e5c02-42b4-453f-9a46-4e7c064c9222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4caaf2-d7f8-4dfb-b468-cccb6e5fb021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4caaf2-d7f8-4dfb-b468-cccb6e5fb021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647ac2ca-2a65-49eb-8350-9a6dbae6f757', 'volume_name': 'volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d0b753-5790-4f9b-bffc-d6077f6c6d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d0b753-5790-4f9b-bffc-d6077f6c6d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3b3cf0-5cb6-47fe-8191-f7cc3fd56141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Volume 647ac2ca-2a65-49eb-8350-9a6dbae6f757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757', 'volume_size': 1} Sep 08 19:05:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:40 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d" returned: 0 in 5.720s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:05:40 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Converted 1024.00 MB image at 178.98 MB/s Sep 08 19:05:40 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d is being set with open permissions: ugo+rw Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:40 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d Sep 08 19:05:40 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:40 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-c1221d68-cd66-4717-9b96-da279c44c89d" released by "_copy_volume_from_snapshot" :: held 7.075s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-a34a0340-0045-494d-a1ba-5f9a0a0b9b90-c1221d68-cd66-4717-9b96-da279c44c89d" released by "_create_volume_from_snapshot" :: held 7.146s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.170s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.414s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-137226713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647ac2ca-2a65-49eb-8350-9a6dbae6f757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e2606b6f1149d8b42b4dd3c1d6af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:35Z,use_quota=True,user_id='9bc1b0635c314911ade50fdccf38af9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Creating volume 647ac2ca-2a65-49eb-8350-9a6dbae6f757 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:05:40 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:40 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 1073741824 Sep 08 19:05:40 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adc8fd3-eba0-46f5-85c2-2ac9c03b1d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1221d68-cd66-4717-9b96-da279c44c89d', 'volume_size': 1, 'snapshot_id': 'a34a0340-0045-494d-a1ba-5f9a0a0b9b90'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9456ad-92f3-4f17-8850-b704e9c1b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Volume volume-c1221d68-cd66-4717-9b96-da279c44c89d (c1221d68-cd66-4717-9b96-da279c44c89d): created successfully Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9456ad-92f3-4f17-8850-b704e9c1b116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Flow 'volume_create_manager' (75a349a5-900e-474b-884c-37d57220f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b739503c-89dd-426a-b318-6c46f5b24c2e tempest-VolumesDeleteCascade-1692094429 None] Created volume successfully. Sep 08 19:05:41 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 1073741824" returned: 0 in 0.465s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:41 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 Sep 08 19:05:41 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-6942b66a-9b1c-43bc-97e4-902526242ff5-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-6942b66a-9b1c-43bc-97e4-902526242ff5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Performing cascade delete. {{(pid=87538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-a34a0340-0045-494d-a1ba-5f9a0a0b9b90-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-a34a0340-0045-494d-a1ba-5f9a0a0b9b90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-6942b66a-9b1c-43bc-97e4-902526242ff5" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-6942b66a-9b1c-43bc-97e4-902526242ff5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-a34a0340-0045-494d-a1ba-5f9a0a0b9b90" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:41 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-a34a0340-0045-494d-a1ba-5f9a0a0b9b90" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Deleting offline snapshot a34a0340-0045-494d-a1ba-5f9a0a0b9b90 of volume 6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] snapshot_file for this snap is: volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3b3cf0-5cb6-47fe-8191-f7cc3fd56141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c11a23f-b857-4a90-a3e1-dd00120230d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d4df0a-7cb7-4065-9711-c5b12fa6fa3b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:41 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Volume volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 (647ac2ca-2a65-49eb-8350-9a6dbae6f757): created successfully Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c11a23f-b857-4a90-a3e1-dd00120230d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Flow 'volume_create_manager' (4d8424f8-6ca8-4ede-9b78-97bf05a0950e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-011b57c2-0692-4960-9de0-81f107ab7a54 tempest-AttachVolumeTestJSON-720472429 None] Created volume successfully. Sep 08 19:05:41 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 Sep 08 19:05:41 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8f05145d-4ca7-4b59-918a-9dcafd398956 tempest-GroupsV320Test-1066570030 None] Group tempest-GroupsV320Test-Group-2087341490: creating Sep 08 19:05:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8f05145d-4ca7-4b59-918a-9dcafd398956 tempest-GroupsV320Test-1066570030 None] Group tempest-GroupsV320Test-Group-2087341490: created successfully Sep 08 19:05:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8f05145d-4ca7-4b59-918a-9dcafd398956 tempest-GroupsV320Test-1066570030 None] Create group completed successfully. Sep 08 19:05:41 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6942b66a-9b1c-43bc-97e4-902526242ff5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a23b3e-16de-4495-a3f7-5eeed57810b4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:42 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 Sep 08 19:05:42 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-d56a60ef-68d1-45b1-9c7f-ec56d2889997 req-810b8f51-2ebf-4fee-a994-29b462b953dc tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-d56a60ef-68d1-45b1-9c7f-ec56d2889997 req-810b8f51-2ebf-4fee-a994-29b462b953dc tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-d56a60ef-68d1-45b1-9c7f-ec56d2889997 req-810b8f51-2ebf-4fee-a994-29b462b953dc tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-d56a60ef-68d1-45b1-9c7f-ec56d2889997 req-810b8f51-2ebf-4fee-a994-29b462b953dc tempest-AttachVolumeTestJSON-720472429 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e570b6e-0f51-4ff9-89c1-503dc7ad412f', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:05:42 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5" returned: 0 in 0.559s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:42 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-d56a60ef-68d1-45b1-9c7f-ec56d2889997 req-810b8f51-2ebf-4fee-a994-29b462b953dc tempest-AttachVolumeTestJSON-720472429 None] attachment_update completed successfully. Sep 08 19:05:42 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 Sep 08 19:05:42 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:42 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90" returned: 0 in 0.448s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:42 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90 Sep 08 19:05:42 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:43 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5.a34a0340-0045-494d-a1ba-5f9a0a0b9b90" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-a34a0340-0045-494d-a1ba-5f9a0a0b9b90" released by "_delete_snapshot" :: held 1.819s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-6942b66a-9b1c-43bc-97e4-902526242ff5" released by "delete_snapshot" :: held 1.860s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Created reservations ['16d1a084-ee97-4a4c-bbce-75d514cf4738'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Created reservations ['09cbe0c3-5b47-4c0a-a029-6bb6847043a3', '7b16011a-f4ff-4f06-97e7-1bac5fbe1da9', '7b5aad31-d138-4b01-876c-b91db752981e', '8e9d9ad3-a775-4999-9126-2aac3b09c88d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:43 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:43 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Delete snapshot completed successfully. Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-a34a0340-0045-494d-a1ba-5f9a0a0b9b90-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Snapshots deleted, issuing volume delete {{(pid=87538) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-6942b66a-9b1c-43bc-97e4-902526242ff5" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-6942b66a-9b1c-43bc-97e4-902526242ff5" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cb9087-a952-48a2-bc6c-e98cbb706387]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:43 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 Sep 08 19:05:43 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:43 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.312s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6f608b09-4975-403c-ac17-ef996a5c74d9 tempest-GroupsV320Test-1066570030 None] Delete group completed successfully. Sep 08 19:05:43 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5" returned: 0 in 0.458s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:44 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5 Sep 08 19:05:44 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:44 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6942b66a-9b1c-43bc-97e4-902526242ff5" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-6942b66a-9b1c-43bc-97e4-902526242ff5" released by "delete_volume" :: held 0.821s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-206a0506-6cb2-4e23-9d0c-19637bc67b54 req-4ec40996-a0fa-431f-a344-914b4c3616a7 tempest-AttachVolumeTestJSON-720472429 None] Terminate volume connection completed successfully. Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-206a0506-6cb2-4e23-9d0c-19637bc67b54 req-4ec40996-a0fa-431f-a344-914b4c3616a7 tempest-AttachVolumeTestJSON-720472429 None] Deleting attachment e3e0c392-9fd1-47e4-a422-1218e84d03d4. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Created reservations ['98acfa02-80e0-494c-a828-9408d635e3cb', '285aaef7-c669-4406-b9b4-e13bc1c7ff3f', 'f99ed8a3-3609-45d8-a8cd-2c9ac2cd03e3', '6a7a53e1-1918-409e-ab79-e444f94cb829'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:44 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:44 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-c1221d68-cd66-4717-9b96-da279c44c89d-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-c1221d68-cd66-4717-9b96-da279c44c89d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:44 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.449s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "cinder-quobyte-c1221d68-cd66-4717-9b96-da279c44c89d" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Deleted volume successfully. Sep 08 19:05:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-c1221d68-cd66-4717-9b96-da279c44c89d" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f76f3f17-6c65-4f3a-b9e0-412d5ea2d4b7 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-6942b66a-9b1c-43bc-97e4-902526242ff5-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[828ad303-29dc-4e79-9040-6269bef63963]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:45 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d Sep 08 19:05:45 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:45 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d" returned: 0 in 0.489s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:45 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d Sep 08 19:05:45 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:45 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c1221d68-cd66-4717-9b96-da279c44c89d" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-quobyte-c1221d68-cd66-4717-9b96-da279c44c89d" released by "delete_volume" :: held 0.860s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-bd2934c3-d732-4f01-a24f-78491e407389 req-0404ea8c-0a30-4ca0-85ce-2945d6cbb829 tempest-AttachVolumeTestJSON-720472429 None] Terminate volume connection completed successfully. Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-bd2934c3-d732-4f01-a24f-78491e407389 req-0404ea8c-0a30-4ca0-85ce-2945d6cbb829 tempest-AttachVolumeTestJSON-720472429 None] Deleting attachment 2e570b6e-0f51-4ff9-89c1-503dc7ad412f. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:05:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Created reservations ['7cf6f401-9cb1-4af2-947a-0a4f9b2037a2', '9a47af14-739e-4ba8-a4aa-0e248570c9f1', '183f570c-cf26-438d-9e5d-7bd5b841fce5', 'f2dac528-b3e9-439e-810f-45ef9d1da807'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:46 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:46 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:46 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.406s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Deleted volume successfully. Sep 08 19:05:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e864e3a4-c4fc-45aa-9533-c33a406efd19 tempest-VolumesDeleteCascade-1692094429 None] Lock "cinder-c1221d68-cd66-4717-9b96-da279c44c89d-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-76f35430-53df-4c48-8f03-352ff7624c7a req-cae7f797-04e9-4c4e-90f7-05ec7c3b6ffa tempest-ServerActionsTestOtherA-151525973 None] Terminate volume connection completed successfully. Sep 08 19:05:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-76f35430-53df-4c48-8f03-352ff7624c7a req-cae7f797-04e9-4c4e-90f7-05ec7c3b6ffa tempest-ServerActionsTestOtherA-151525973 None] Deleting attachment 3d017cff-328b-450f-9fda-32a1b4a8d0ad. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:05:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "cinder-9dd7edea-70e6-435b-bba8-ff72e187cca2-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-9dd7edea-70e6-435b-bba8-ff72e187cca2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "cinder-quobyte-9dd7edea-70e6-435b-bba8-ff72e187cca2" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-quobyte-9dd7edea-70e6-435b-bba8-ff72e187cca2" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:50 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[52202955-9bb0-4cdd-a3a3-b9aebe8d9983]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:50 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 Sep 08 19:05:50 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:51 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2" returned: 0 in 0.707s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:51 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2 Sep 08 19:05:51 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:51 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dd7edea-70e6-435b-bba8-ff72e187cca2" returned: 0 in 0.414s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-quobyte-9dd7edea-70e6-435b-bba8-ff72e187cca2" released by "delete_volume" :: held 1.224s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG cinder.quota [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Created reservations ['9c4e851d-8586-4257-aa93-09ae09181c63', '01bc4d42-3591-4b93-8059-b616d0ac17db', 'd98196c9-297d-48d9-825c-07d80f7257f5', 'b239444e-9d28-43b9-863f-f92d0a258e6f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:51 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:51 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:52 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.260s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG cinder.manager [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Deleted volume successfully. Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-76f35430-53df-4c48-8f03-352ff7624c7a req-78839e3b-4141-45e4-ae19-cede541b5b5f tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-9dd7edea-70e6-435b-bba8-ff72e187cca2-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "cinder-bc4db7f2-9487-4e09-ba2c-98db096c9e3f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-bc4db7f2-9487-4e09-ba2c-98db096c9e3f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "cinder-quobyte-bc4db7f2-9487-4e09-ba2c-98db096c9e3f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-quobyte-bc4db7f2-9487-4e09-ba2c-98db096c9e3f" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1100b20e-cc7c-4af0-b028-94230c54df7d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:52 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f Sep 08 19:05:52 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:52 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f" returned: 0 in 0.439s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:52 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f Sep 08 19:05:52 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:53 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc4db7f2-9487-4e09-ba2c-98db096c9e3f" returned: 0 in 0.347s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-quobyte-bc4db7f2-9487-4e09-ba2c-98db096c9e3f" released by "delete_volume" :: held 0.836s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Created reservations ['3d5c7026-ee77-410c-8b56-9e3c4a088426', 'eb4e8a85-bc2a-4ad6-ac86-aeb3343499bf', '1e6ffb47-2895-47c6-b46a-345df53adc5f', 'db433ecb-85ae-44a6-a7ef-ae551cb1909d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:53 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:53 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:53 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.410s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Deleted volume successfully. Sep 08 19:05:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c5d8b3c-a971-4ea8-b2f7-470e26cd81ca tempest-ServerActionsTestOtherA-151525973 None] Lock "cinder-bc4db7f2-9487-4e09-ba2c-98db096c9e3f-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "cinder-647ac2ca-2a65-49eb-8350-9a6dbae6f757-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-647ac2ca-2a65-49eb-8350-9a6dbae6f757-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "cinder-quobyte-647ac2ca-2a65-49eb-8350-9a6dbae6f757" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-quobyte-647ac2ca-2a65-49eb-8350-9a6dbae6f757" acquired by "delete_volume" :: waited 0.037s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4885cc-1447-4311-b714-40c9fb4a50a1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:54 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 Sep 08 19:05:54 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:54 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757" returned: 0 in 0.564s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:55 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757 Sep 08 19:05:55 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:55 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-647ac2ca-2a65-49eb-8350-9a6dbae6f757" returned: 0 in 0.427s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-quobyte-647ac2ca-2a65-49eb-8350-9a6dbae6f757" released by "delete_volume" :: held 1.101s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Created reservations ['1574199f-4e37-4639-b9fb-ab5b682988a4', 'bd699e97-df8d-4356-acea-a679d7e429cd', '8ddf4be7-26b5-49a3-919a-1ed891be2412', 'bcf31925-0971-4e74-b9af-46bd7a266fec'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Flow 'volume_create_manager' (9bf47b2c-4cf1-4077-989f-4dee67d34583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f758e4-ef38-4fd0-9237-11a87ef50210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f758e4-ef38-4fd0-9237-11a87ef50210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-813245266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02bfdbea-ef15-40e3-9570-299e10990b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82001aeb7df44a1bbbc602b379e61a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:56Z,use_quota=True,user_id='c98a0cadf7cc4d3cb6b4f4261cd858cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f3ea8-8d7b-45af-826f-0b8026507c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092f3ea8-8d7b-45af-826f-0b8026507c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d0dfb5-aaf2-486d-a39d-30559308e085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d0dfb5-aaf2-486d-a39d-30559308e085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02bfdbea-ef15-40e3-9570-299e10990b0f', 'volume_name': 'volume-02bfdbea-ef15-40e3-9570-299e10990b0f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92cdb2f-7c4a-473f-8bbf-1c885563232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92cdb2f-7c4a-473f-8bbf-1c885563232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0a4f88-4604-4afa-9dbd-ba45e3624944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:55 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Volume 02bfdbea-ef15-40e3-9570-299e10990b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02bfdbea-ef15-40e3-9570-299e10990b0f', 'volume_size': 1} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-813245266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02bfdbea-ef15-40e3-9570-299e10990b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82001aeb7df44a1bbbc602b379e61a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:05:56Z,use_quota=True,user_id='c98a0cadf7cc4d3cb6b4f4261cd858cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Creating volume 02bfdbea-ef15-40e3-9570-299e10990b0f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:05:55 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:55 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f 1073741824 Sep 08 19:05:55 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:55 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:55 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:56 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Deleted volume successfully. Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-638a83d8-35ee-4851-9f45-3b6640dce20e tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-647ac2ca-2a65-49eb-8350-9a6dbae6f757-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:56 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f 1073741824" returned: 0 in 0.530s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:56 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f Sep 08 19:05:56 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "cinder-8c36f2f9-2e60-4ce1-a795-c1b534c3213c-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:56 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-8c36f2f9-2e60-4ce1-a795-c1b534c3213c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0a4f88-4604-4afa-9dbd-ba45e3624944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02bfdbea-ef15-40e3-9570-299e10990b0f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9ecd06-1401-4f8c-a60e-1a2872059ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:05:56 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Volume volume-02bfdbea-ef15-40e3-9570-299e10990b0f (02bfdbea-ef15-40e3-9570-299e10990b0f): created successfully Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9ecd06-1401-4f8c-a60e-1a2872059ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Flow 'volume_create_manager' (9bf47b2c-4cf1-4077-989f-4dee67d34583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:05:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-78f8256c-5713-47c7-bc1b-499592e6beab tempest-VolumesTransfersV355Test-440810063 None] Created volume successfully. Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "cinder-quobyte-8c36f2f9-2e60-4ce1-a795-c1b534c3213c" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-quobyte-8c36f2f9-2e60-4ce1-a795-c1b534c3213c" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf4c7f0-7bfb-4773-9e44-5b7a68127f11]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:57 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c Sep 08 19:05:57 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:57 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c" returned: 0 in 0.525s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:57 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c Sep 08 19:05:57 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:57 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8c36f2f9-2e60-4ce1-a795-c1b534c3213c" returned: 0 in 0.310s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-quobyte-8c36f2f9-2e60-4ce1-a795-c1b534c3213c" released by "delete_volume" :: held 0.889s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Created reservations ['6a53e203-79ec-41a7-8bd7-2fbb1d9b5978', '824b650e-b85a-464c-8426-4d9817e0f50c', '27f6bbe3-4125-483e-95ab-fa73d2306390', 'b1c79f4d-d419-4f3e-be48-22fdb8c464f0'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:05:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:57 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:05:57 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:58 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.295s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:58 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:05:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Deleted volume successfully. Sep 08 19:05:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8c53d254-de12-44a7-9460-25aea809a09b tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-8c36f2f9-2e60-4ce1-a795-c1b534c3213c-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:05:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-af8b9760-0267-4ce9-b65a-88cbe0572bc8 tempest-VolumesTransfersV355Test-1901009470 None] Transfer volume completed successfully. Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Acquiring lock "cinder-02bfdbea-ef15-40e3-9570-299e10990b0f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-02bfdbea-ef15-40e3-9570-299e10990b0f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "cinder-c97b0f36-8e0b-460a-a5ac-9dafac7302c5-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Acquiring lock "cinder-quobyte-02bfdbea-ef15-40e3-9570-299e10990b0f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-c97b0f36-8e0b-460a-a5ac-9dafac7302c5-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-quobyte-02bfdbea-ef15-40e3-9570-299e10990b0f" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef6428-6d52-454f-9de5-f26b43b70975]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "cinder-quobyte-c97b0f36-8e0b-460a-a5ac-9dafac7302c5" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-quobyte-c97b0f36-8e0b-460a-a5ac-9dafac7302c5" acquired by "delete_volume" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf4853-3f05-4396-8441-5f752f22a8d3]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:59 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f Sep 08 19:05:59 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:59 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 Sep 08 19:05:59 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:59 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f" returned: 0 in 0.498s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:59 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f Sep 08 19:05:59 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:05:59 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5" returned: 0 in 0.497s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:05:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:05:59 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5 Sep 08 19:05:59 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:00 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02bfdbea-ef15-40e3-9570-299e10990b0f" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-quobyte-02bfdbea-ef15-40e3-9570-299e10990b0f" released by "delete_volume" :: held 0.858s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Created reservations ['7ef44ffe-ad1d-4e58-b4a9-915d7f5f1255', '3a51dc6a-ba26-4a50-a13c-286f57b086ff', 'eefa36c4-3edf-46e6-bf64-75e461f8d6a3', '7eaec1ba-524c-40e7-b575-1b3d636a357d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:00 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97b0f36-8e0b-460a-a5ac-9dafac7302c5" returned: 0 in 0.366s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-quobyte-c97b0f36-8e0b-460a-a5ac-9dafac7302c5" released by "delete_volume" :: held 0.924s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Created reservations ['4d9d2ca8-05c8-471f-b0a2-c34a8966e18b', 'ef32c0ba-bc6b-4b5d-a251-14bdafddd594', '19f82303-2beb-4b45-9e6e-bb517fbe3045', '0b33fcbb-fa24-4b95-8fbd-2045c458f470'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:00 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:00 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:00 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:00 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:00 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.337s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Deleted volume successfully. Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-281f4dc4-0dd1-4b38-baa3-b8537f85b79c tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-02bfdbea-ef15-40e3-9570-299e10990b0f-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:00 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.348s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Deleted volume successfully. Sep 08 19:06:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3892c909-abf6-4be3-8143-1f8b1f428370 tempest-AttachVolumeTestJSON-720472429 None] Lock "cinder-c97b0f36-8e0b-460a-a5ac-9dafac7302c5-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:01 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Flow 'volume_create_manager' (172c354d-3114-4a6f-9b50-9069599d7314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde57414-c58f-4c5a-8f45-839ca5d61563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fde57414-c58f-4c5a-8f45-839ca5d61563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1039346204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c4d55c-9fc5-4e3d-b935-040b3b02dd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82001aeb7df44a1bbbc602b379e61a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:02Z,use_quota=True,user_id='c98a0cadf7cc4d3cb6b4f4261cd858cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392521d9-d733-4bd8-a67e-69d6aa40f697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392521d9-d733-4bd8-a67e-69d6aa40f697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94fe022-ffeb-432e-975c-bcf2c325456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94fe022-ffeb-432e-975c-bcf2c325456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c4d55c-9fc5-4e3d-b935-040b3b02dd8b', 'volume_name': 'volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40b1034-4107-4ae5-9df2-9d21c1c19940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40b1034-4107-4ae5-9df2-9d21c1c19940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131b6a8c-a555-4123-8623-11ec88658a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Volume 02c4d55c-9fc5-4e3d-b935-040b3b02dd8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b', 'volume_size': 1} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1039346204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c4d55c-9fc5-4e3d-b935-040b3b02dd8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82001aeb7df44a1bbbc602b379e61a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:02Z,use_quota=True,user_id='c98a0cadf7cc4d3cb6b4f4261cd858cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Creating volume 02c4d55c-9fc5-4e3d-b935-040b3b02dd8b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:02 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:02 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b 1073741824 Sep 08 19:06:02 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:02 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b 1073741824" returned: 0 in 0.629s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:02 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b Sep 08 19:06:02 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:03 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b" returned: 0 in 0.282s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (131b6a8c-a555-4123-8623-11ec88658a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f5d427-be90-4ed8-b696-2ee3bbcdaf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:03 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Volume volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b (02c4d55c-9fc5-4e3d-b935-040b3b02dd8b): created successfully Sep 08 19:06:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f5d427-be90-4ed8-b696-2ee3bbcdaf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Flow 'volume_create_manager' (172c354d-3114-4a6f-9b50-9069599d7314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:03 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9364bba5-f400-4296-bfbf-e06d7e4568b3 tempest-VolumesTransfersV355Test-440810063 None] Created volume successfully. Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Flow 'volume_create_manager' (f0a1ed6d-4075-4db5-9b08-364d58777cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aea6f9a-5f72-4a89-b25c-3e27f3a0562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aea6f9a-5f72-4a89-b25c-3e27f3a0562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-958462020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4af6d4-6eac-426e-95ad-c1239c8d0998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa77aaefa16b481b97c574d9a979d874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:04Z,use_quota=True,user_id='edb034efd5ae41d090615e3560e43a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515b586f-343d-4dc8-91de-88cbbe6ef0ff),volume_type_id=515b586f-343d-4dc8-91de-88cbbe6ef0ff)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0807062-46ff-4c9b-9f2f-25534564c4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0807062-46ff-4c9b-9f2f-25534564c4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32c9550-f603-489a-9578-a816e6a9aaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32c9550-f603-489a-9578-a816e6a9aaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4af6d4-6eac-426e-95ad-c1239c8d0998', 'volume_name': 'volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904908a2-ca62-4cef-a9d2-e7650052e209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (904908a2-ca62-4cef-a9d2-e7650052e209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c24fcd-8979-4339-a5b1-e1d726160bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Volume ee4af6d4-6eac-426e-95ad-c1239c8d0998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998', 'volume_size': 1} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-958462020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4af6d4-6eac-426e-95ad-c1239c8d0998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa77aaefa16b481b97c574d9a979d874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:04Z,use_quota=True,user_id='edb034efd5ae41d090615e3560e43a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515b586f-343d-4dc8-91de-88cbbe6ef0ff),volume_type_id=515b586f-343d-4dc8-91de-88cbbe6ef0ff)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Creating volume ee4af6d4-6eac-426e-95ad-c1239c8d0998 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:04 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Acquiring lock "cinder-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:04 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 1073741824 Sep 08 19:06:04 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Acquiring lock "cinder-quobyte-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-quobyte-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb47be-8770-40ed-8ef3-9fd91b3f422e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:04 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b Sep 08 19:06:04 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:05 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 1073741824" returned: 0 in 0.577s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:05 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 Sep 08 19:06:05 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:05 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b" returned: 0 in 0.520s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:05 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b Sep 08 19:06:05 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:05 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998" returned: 0 in 0.284s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c24fcd-8979-4339-a5b1-e1d726160bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8f7fc6-3b64-4e6a-80a1-749968a6e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:05 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:05 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Volume volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 (ee4af6d4-6eac-426e-95ad-c1239c8d0998): created successfully Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8f7fc6-3b64-4e6a-80a1-749968a6e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Flow 'volume_create_manager' (f0a1ed6d-4075-4db5-9b08-364d58777cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-16eae6dc-a486-4ee1-8fb7-14533163e710 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Created volume successfully. Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-quobyte-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b" released by "delete_volume" :: held 0.886s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Created reservations ['18a4cd1f-4001-4161-bfa6-15760bb145dc', 'f6d9ecdc-0a48-41f6-ac31-8dec48b22ecb', '67631971-ccb6-428a-bdf2-460f7e68e434', '1f92bb7d-f2ab-4062-98ae-9d5a63ae805a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:05 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:05 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:06 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.364s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:06 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:06 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Deleted volume successfully. Sep 08 19:06:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d5fcf9a-bd07-4c7d-a881-50d2acc3ef27 tempest-VolumesTransfersV355Test-1195871760 None] Lock "cinder-02c4d55c-9fc5-4e3d-b935-040b3b02dd8b-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:07 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:07 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:07 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.326s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:07 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-db70476d-3229-4b11-ae2d-208a1542aea8 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Retype volume completed successfully. Sep 08 19:06:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Acquiring lock "cinder-ee4af6d4-6eac-426e-95ad-c1239c8d0998-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "cinder-ee4af6d4-6eac-426e-95ad-c1239c8d0998-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Acquiring lock "cinder-quobyte-ee4af6d4-6eac-426e-95ad-c1239c8d0998" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "cinder-quobyte-ee4af6d4-6eac-426e-95ad-c1239c8d0998" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910ffb7-12db-463f-9d06-0bbd10dfa7f4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:08 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 Sep 08 19:06:08 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:09 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998" returned: 0 in 0.484s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:09 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998 Sep 08 19:06:09 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:09 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ee4af6d4-6eac-426e-95ad-c1239c8d0998" returned: 0 in 0.361s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "cinder-quobyte-ee4af6d4-6eac-426e-95ad-c1239c8d0998" released by "delete_volume" :: held 0.907s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:09 devstack cinder-volume[87538]: WARNING cinder.quota [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:06:09 devstack cinder-volume[87538]: WARNING cinder.quota [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Created reservations ['06eca0ac-8faf-4104-aef0-5e23341d045a', '8da85a11-dcf3-4c32-a378-1ac7a5274a07', 'f1d9d1e7-2e1a-4160-a509-eb1e945032fb', 'c571030b-7f5c-48c4-a59a-5ef0fe4ab318'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:09 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:09 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:10 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.331s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:10 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Deleted volume successfully. Sep 08 19:06:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9117b0c5-ab44-4845-a659-aeaeef1b8292 tempest-VolumeRetypeWithoutMigrationTest-2088798212 None] Lock "cinder-ee4af6d4-6eac-426e-95ad-c1239c8d0998-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Flow 'volume_create_manager' (dfc3a280-c97f-40a2-9346-192566fb0bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1f46fc-9a5f-4585-b5df-e1a170d3b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1f46fc-9a5f-4585-b5df-e1a170d3b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1426645829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601a00a0-4061-417b-94c5-cb400641cb6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd88f038e6b4fb087c479dd5da87a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:12Z,use_quota=True,user_id='2b909befddeb429d839f89e74808d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c4020f-2bc8-4f7e-aa62-9cf252ed43ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c4020f-2bc8-4f7e-aa62-9cf252ed43ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dfcd66-dd58-4aa1-8909-07fbe0659bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dfcd66-dd58-4aa1-8909-07fbe0659bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601a00a0-4061-417b-94c5-cb400641cb6b', 'volume_name': 'volume-601a00a0-4061-417b-94c5-cb400641cb6b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf54a0a-8d9b-437c-8a8a-1220cc30ace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf54a0a-8d9b-437c-8a8a-1220cc30ace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cf0fbe-7c07-49d2-948b-1d776bc3cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:11 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Volume 601a00a0-4061-417b-94c5-cb400641cb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601a00a0-4061-417b-94c5-cb400641cb6b', 'volume_size': 1} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1426645829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601a00a0-4061-417b-94c5-cb400641cb6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd88f038e6b4fb087c479dd5da87a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:12Z,use_quota=True,user_id='2b909befddeb429d839f89e74808d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Creating volume 601a00a0-4061-417b-94c5-cb400641cb6b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:11 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:11 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b 1073741824 Sep 08 19:06:11 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:12 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b 1073741824" returned: 0 in 0.602s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:12 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b Sep 08 19:06:12 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:12 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b" returned: 0 in 0.322s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cf0fbe-7c07-49d2-948b-1d776bc3cce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601a00a0-4061-417b-94c5-cb400641cb6b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b3ce8a-9136-4e05-b2e0-56e410ac7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:12 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Volume volume-601a00a0-4061-417b-94c5-cb400641cb6b (601a00a0-4061-417b-94c5-cb400641cb6b): created successfully Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b3ce8a-9136-4e05-b2e0-56e410ac7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Flow 'volume_create_manager' (dfc3a280-c97f-40a2-9346-192566fb0bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f185581c-631d-4f23-b2f3-d9af66f0f3e9 tempest-VolumesTestJSON-1683303087 None] Created volume successfully. Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Flow 'volume_create_manager' (599e8a77-1224-4720-9404-3e1d0dc28879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee309ed4-b9cf-4dad-a57a-5e287592d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee309ed4-b9cf-4dad-a57a-5e287592d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-605979506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d144841-8414-4266-ad53-12fd3a0bb37c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd88f038e6b4fb087c479dd5da87a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:15Z,use_quota=True,user_id='2b909befddeb429d839f89e74808d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ca33e3-6e56-4a2b-80b6-862060ec7dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ca33e3-6e56-4a2b-80b6-862060ec7dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e495ef-b5fd-41c7-907e-116b60f50129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e495ef-b5fd-41c7-907e-116b60f50129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d144841-8414-4266-ad53-12fd3a0bb37c', 'volume_name': 'volume-9d144841-8414-4266-ad53-12fd3a0bb37c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057bb93e-64c7-4f34-b155-ae3d4002efee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057bb93e-64c7-4f34-b155-ae3d4002efee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b2b5cb-9ada-436f-a205-e65b26a6dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:14 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Volume 9d144841-8414-4266-ad53-12fd3a0bb37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d144841-8414-4266-ad53-12fd3a0bb37c', 'volume_size': 1} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-605979506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d144841-8414-4266-ad53-12fd3a0bb37c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd88f038e6b4fb087c479dd5da87a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:15Z,use_quota=True,user_id='2b909befddeb429d839f89e74808d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Creating volume 9d144841-8414-4266-ad53-12fd3a0bb37c {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:14 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:14 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c 1073741824 Sep 08 19:06:14 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:15 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c 1073741824" returned: 0 in 0.629s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:15 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c Sep 08 19:06:15 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:15 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c" returned: 0 in 0.353s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b2b5cb-9ada-436f-a205-e65b26a6dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d144841-8414-4266-ad53-12fd3a0bb37c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a18017d-04e7-4e89-bb66-45754ce7e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:15 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Volume volume-9d144841-8414-4266-ad53-12fd3a0bb37c (9d144841-8414-4266-ad53-12fd3a0bb37c): created successfully Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a18017d-04e7-4e89-bb66-45754ce7e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Flow 'volume_create_manager' (599e8a77-1224-4720-9404-3e1d0dc28879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7a1fb165-c745-4ae5-9498-a4a2d6bd049b tempest-VolumesTestJSON-1683303087 None] Created volume successfully. Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Flow 'volume_create_manager' (f5125258-8e9b-4266-af82-2fbc2aa04a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faadd73-4b88-4710-bb5c-309791b62ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6faadd73-4b88-4710-bb5c-309791b62ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-895238230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f57bdc-241f-4625-921b-b5867d906d1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd88f038e6b4fb087c479dd5da87a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:17Z,use_quota=True,user_id='2b909befddeb429d839f89e74808d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49245af-afd0-4ee8-b38e-3abc516c5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49245af-afd0-4ee8-b38e-3abc516c5273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd3e7c8-abe0-4ac0-919e-0b28bd4d5bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd3e7c8-abe0-4ac0-919e-0b28bd4d5bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f57bdc-241f-4625-921b-b5867d906d1a', 'volume_name': 'volume-c9f57bdc-241f-4625-921b-b5867d906d1a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668e178d-7bdf-4f38-9e36-259cf8387ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668e178d-7bdf-4f38-9e36-259cf8387ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd495ba-385e-4939-8e0e-d3bc6b39e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:17 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Volume c9f57bdc-241f-4625-921b-b5867d906d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f57bdc-241f-4625-921b-b5867d906d1a', 'volume_size': 1} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-895238230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f57bdc-241f-4625-921b-b5867d906d1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0fd88f038e6b4fb087c479dd5da87a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:17Z,use_quota=True,user_id='2b909befddeb429d839f89e74808d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Creating volume c9f57bdc-241f-4625-921b-b5867d906d1a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:17 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:17 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a 1073741824 Sep 08 19:06:17 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:18 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a 1073741824" returned: 0 in 0.748s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:18 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a Sep 08 19:06:18 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:18 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a" returned: 0 in 0.378s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd495ba-385e-4939-8e0e-d3bc6b39e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f57bdc-241f-4625-921b-b5867d906d1a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5089839-c1ce-4cf0-b437-0b468fcfc70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:18 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Volume volume-c9f57bdc-241f-4625-921b-b5867d906d1a (c9f57bdc-241f-4625-921b-b5867d906d1a): created successfully Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5089839-c1ce-4cf0-b437-0b468fcfc70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Flow 'volume_create_manager' (f5125258-8e9b-4266-af82-2fbc2aa04a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:18 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-83493104-baeb-48d1-866e-2df565899d0d tempest-VolumesTestJSON-1683303087 None] Created volume successfully. Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Flow 'volume_create_manager' (2aa5c45d-d2e3-4033-be55-db30822de896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce271183-f72a-4999-a1ec-bcc7e64241b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce271183-f72a-4999-a1ec-bcc7e64241b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-837991913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae315ea-4fb7-4166-9e3b-8455ec09b324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34f94348ca0446bba466b43f4ac5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:19Z,use_quota=True,user_id='086c4d177b784cba93fabc71b15b845d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca722e3-0064-4c9d-a353-322318fbe1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca722e3-0064-4c9d-a353-322318fbe1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa09571-1da5-4796-b08c-ce9f98cde650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa09571-1da5-4796-b08c-ce9f98cde650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ae315ea-4fb7-4166-9e3b-8455ec09b324', 'volume_name': 'volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d047a3a-d36d-4c84-8073-f40588f3a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d047a3a-d36d-4c84-8073-f40588f3a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe7087-e578-4c7c-a06a-a60be203e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:20 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Volume 5ae315ea-4fb7-4166-9e3b-8455ec09b324: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Trying to clone 5ae315ea-4fb7-4166-9e3b-8455ec09b324 from image 8499e13e-f314-4011-953c-7c51abb2061c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:06:20 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727d36f-7b67-4109-b6f6-d896500f81ea]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:20 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD Sep 08 19:06:20 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Acquiring lock "cinder-c9f57bdc-241f-4625-921b-b5867d906d1a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Lock "cinder-c9f57bdc-241f-4625-921b-b5867d906d1a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:20 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c is fetched for user 086c4d177b784cba93fabc71b15b845d. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:06:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Acquiring lock "cinder-quobyte-c9f57bdc-241f-4625-921b-b5867d906d1a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Lock "cinder-quobyte-c9f57bdc-241f-4625-921b-b5867d906d1a" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d49a73d-2e7f-4a68-9a60-0321a2a7f78c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Flow 'volume_create_manager' (66d1235b-d30b-4bcb-9a22-d3ccbe00bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f8d32d-a694-45ee-b0d4-f38dc8b3c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f8d32d-a694-45ee-b0d4-f38dc8b3c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-213551888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296dab8b-4ab0-433c-9859-115f037ee3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4afe8840cbf4df4a8a680f8ff1ff1dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:21Z,use_quota=True,user_id='f85ed407de3641c0a4677dfc36184f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88f0991-cfd3-4e0f-9989-7792338f6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88f0991-cfd3-4e0f-9989-7792338f6521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192ed6e9-4e9a-43ef-846a-ad1b8b8a31bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192ed6e9-4e9a-43ef-846a-ad1b8b8a31bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296dab8b-4ab0-433c-9859-115f037ee3e5', 'volume_name': 'volume-296dab8b-4ab0-433c-9859-115f037ee3e5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958787cc-e9e3-4c87-a7f8-b9942c3df8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958787cc-e9e3-4c87-a7f8-b9942c3df8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:21 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a Sep 08 19:06:21 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972a7e53-5f8f-4afd-a901-6d45e76b2336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:21 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Volume 296dab8b-4ab0-433c-9859-115f037ee3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296dab8b-4ab0-433c-9859-115f037ee3e5', 'volume_size': 1} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-213551888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296dab8b-4ab0-433c-9859-115f037ee3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4afe8840cbf4df4a8a680f8ff1ff1dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:21Z,use_quota=True,user_id='f85ed407de3641c0a4677dfc36184f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Creating volume 296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:21 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ceae4-73ec-4f04-a39b-bed3d9ee383b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:21 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 1073741824 Sep 08 19:06:21 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:21 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD Sep 08 19:06:21 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:21 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a" returned: 0 in 0.401s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:21 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a Sep 08 19:06:21 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:21 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:21 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 1073741824" returned: 0 in 0.499s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:21 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c9f57bdc-241f-4625-921b-b5867d906d1a" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:21 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 Sep 08 19:06:21 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Lock "cinder-quobyte-c9f57bdc-241f-4625-921b-b5867d906d1a" released by "delete_volume" :: held 0.729s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Created reservations ['9897056e-163f-42cb-a5e6-f7d95bdf64e2', 'f375f686-7399-4916-a268-a9f4fb75467f', '80f28c55-1920-494b-af94-e0165cc4033a', 'ce952628-26da-484a-a293-03a80fd1c283'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:21 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:21 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:22 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-837991913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae315ea-4fb7-4166-9e3b-8455ec09b324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34f94348ca0446bba466b43f4ac5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:19Z,use_quota=True,user_id='086c4d177b784cba93fabc71b15b845d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Creating volume 5ae315ea-4fb7-4166-9e3b-8455ec09b324 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:22 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "cinder-9d144841-8414-4266-ad53-12fd3a0bb37c-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972a7e53-5f8f-4afd-a901-6d45e76b2336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296dab8b-4ab0-433c-9859-115f037ee3e5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:22 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 1073741824 Sep 08 19:06:22 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f673790-d941-45bb-9786-fcff26a36cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:22 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Volume volume-296dab8b-4ab0-433c-9859-115f037ee3e5 (296dab8b-4ab0-433c-9859-115f037ee3e5): created successfully Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f673790-d941-45bb-9786-fcff26a36cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Flow 'volume_create_manager' (66d1235b-d30b-4bcb-9a22-d3ccbe00bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-9d144841-8414-4266-ad53-12fd3a0bb37c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0b9ff1c0-4b8b-4bf5-84f1-90cbc5b2103a tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Created volume successfully. Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "cinder-quobyte-9d144841-8414-4266-ad53-12fd3a0bb37c" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-quobyte-9d144841-8414-4266-ad53-12fd3a0bb37c" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:22 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.363s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Deleted volume successfully. Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a33c8-4507-4a85-ada6-c7bfd942228b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f595b01-ec59-4d89-9ded-b1b8460c4aff tempest-VolumesTestJSON-1683303087 None] Lock "cinder-c9f57bdc-241f-4625-921b-b5867d906d1a-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:22 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c Sep 08 19:06:22 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:22 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 1073741824" returned: 0 in 0.619s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:22 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 Sep 08 19:06:22 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:22 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c" returned: 0 in 0.483s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:22 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c Sep 08 19:06:22 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:23 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324" returned: 0 in 0.325s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Attempting download of 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 5ae315ea-4fb7-4166-9e3b-8455ec09b324. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:06:23 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9d144841-8414-4266-ad53-12fd3a0bb37c" returned: 0 in 0.357s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4634d-c86a-4c96-985d-c97646971413]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_q380jd3t {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-quobyte-9d144841-8414-4266-ad53-12fd3a0bb37c" released by "delete_volume" :: held 0.922s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Created reservations ['01f44114-91ed-4fb0-9c2b-9f85af8390f1', '9d6652e7-1207-445a-ba49-ed12f078e567', 'e20b86bc-3dfc-4485-9daa-df47c94fbcb8', 'bbb0bd48-9180-4929-a5a9-c686f5db856f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Creating offline snapshot 6f4a479f-8a42-4fa7-953b-223e5bbda019 of volume 296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:06:23 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_q380jd3t Sep 08 19:06:23 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[deef00ad-cfd6-4dfa-a685-7cd4537f51f6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:23 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:23 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:23 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 Sep 08 19:06:23 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:23 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_q380jd3t" returned: 0 in 0.506s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_q380jd3t {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:23 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.371s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Deleted volume successfully. Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-db614801-d1f4-4934-84d9-28aba1d5f583 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-9d144841-8414-4266-ad53-12fd3a0bb37c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:23 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_q380jd3t Sep 08 19:06:23 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:23 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5" returned: 0 in 0.482s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:23 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 1G Sep 08 19:06:23 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:24 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_q380jd3t" returned: 1 in 0.361s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_q380jd3t' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b1a51-a5a5-4276-8bb7-ba89ea2cfb8d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:24 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD Sep 08 19:06:24 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:24 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 1G" returned: 0 in 0.461s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-296dab8b-4ab0-433c-9859-115f037ee3e5 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:24 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-296dab8b-4ab0-433c-9859-115f037ee3e5 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 Sep 08 19:06:24 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:24 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "cinder-601a00a0-4061-417b-94c5-cb400641cb6b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] 8499e13e-f314-4011-953c-7c51abb2061c was qcow2, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-601a00a0-4061-417b-94c5-cb400641cb6b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:24 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 Sep 08 19:06:24 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "cinder-quobyte-601a00a0-4061-417b-94c5-cb400641cb6b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-quobyte-601a00a0-4061-417b-94c5-cb400641cb6b" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b22766-3a1f-45d9-81f7-5f7bcf61e6ca]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:24 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:24 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b Sep 08 19:06:24 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-296dab8b-4ab0-433c-9859-115f037ee3e5 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019" returned: 0 in 0.468s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:24 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 is being set with open permissions: ugo+rw Sep 08 19:06:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:24 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 Sep 08 19:06:24 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:25 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019" returned: 0 in 0.322s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:25 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b" returned: 0 in 0.483s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:25 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b Sep 08 19:06:25 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:25 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.info Sep 08 19:06:25 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:25 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.info" returned: 0 in 0.292s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:25 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.info is being set with open permissions: ugo+rw Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:25 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.info Sep 08 19:06:25 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:25 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601a00a0-4061-417b-94c5-cb400641cb6b" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-quobyte-601a00a0-4061-417b-94c5-cb400641cb6b" released by "delete_volume" :: held 0.962s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Created reservations ['82ba9637-3671-41b4-85fa-c185d5fabe06', 'f1a0c53e-90b2-46e0-bb7e-0fa193201ded', 'dab61ebf-05f4-423d-b66b-4170cf49e523', '8e69b2c1-ee3f-46eb-a51d-7c3a41e51a64'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:25 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.info" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:25 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:25 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f071cb88-45fa-46ac-8747-c38ab5d057c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Create snapshot completed successfully Sep 08 19:06:26 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.352s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:26 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Deleted volume successfully. Sep 08 19:06:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ced3a2b0-4f13-4ba4-9723-b1f428349fb7 tempest-VolumesTestJSON-1683303087 None] Lock "cinder-601a00a0-4061-417b-94c5-cb400641cb6b-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:26 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324" returned: 0 in 2.494s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:26 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l05o05sddevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:06:26 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Converted 112.00 MB image at 44.90 MB/s Sep 08 19:06:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:26 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 1G Sep 08 19:06:26 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "cinder-6f4a479f-8a42-4fa7-953b-223e5bbda019-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-6f4a479f-8a42-4fa7-953b-223e5bbda019-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "cinder-quobyte-296dab8b-4ab0-433c-9859-115f037ee3e5" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-quobyte-296dab8b-4ab0-433c-9859-115f037ee3e5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "cinder-quobyte-6f4a479f-8a42-4fa7-953b-223e5bbda019" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-quobyte-6f4a479f-8a42-4fa7-953b-223e5bbda019" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Deleting offline snapshot 6f4a479f-8a42-4fa7-953b-223e5bbda019 of volume 296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] snapshot_file for this snap is: volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450e868-6229-4870-bb5f-ce5f7bcab2b8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:27 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:27 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 Sep 08 19:06:27 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 1G" returned: 0 in 0.485s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Downloaded image 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 5ae315ea-4fb7-4166-9e3b-8455ec09b324 successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c for user 086c4d177b784cba93fabc71b15b845d is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Marking volume 5ae315ea-4fb7-4166-9e3b-8455ec09b324 as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=187,cinder:SELECT=148,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Copying metadata from image 8499e13e-f314-4011-953c-7c51abb2061c to 5ae315ea-4fb7-4166-9e3b-8455ec09b324. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Creating volume glance metadata for volume 5ae315ea-4fb7-4166-9e3b-8455ec09b324 backed by image 8499e13e-f314-4011-953c-7c51abb2061c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=180,cinder:SELECT=155,cinder:INSERT=45,cinder:DELETE=14 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe7087-e578-4c7c-a06a-a60be203e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31f90d9-f980-4ed5-87fe-b041524d4ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Volume volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 (5ae315ea-4fb7-4166-9e3b-8455ec09b324): created successfully Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31f90d9-f980-4ed5-87fe-b041524d4ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Flow 'volume_create_manager' (2aa5c45d-d2e3-4033-be55-db30822de896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ca8d5de1-5d4b-4774-9a81-5caa79cf4783 tempest-VolumesExtendTest-1478217891 None] Created volume successfully. Sep 08 19:06:27 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019" returned: 0 in 0.497s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-296dab8b-4ab0-433c-9859-115f037ee3e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[79776865-4f6a-42e3-861d-ffedebb73017]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:27 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 Sep 08 19:06:27 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:28 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5" returned: 0 in 0.464s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:28 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 Sep 08 19:06:28 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[104ce6d3-08ea-460b-9946-59f23f5ecc48]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:28 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 Sep 08 19:06:28 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:28 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019" returned: 0 in 0.641s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:28 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019 Sep 08 19:06:28 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:29 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324" returned: 0 in 0.695s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 2G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 2G" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7fad86d9-26ae-4041-aecb-f641598263df tempest-VolumesExtendTest-1478217891 None] Extend volume completed successfully. Sep 08 19:06:29 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5.6f4a479f-8a42-4fa7-953b-223e5bbda019" returned: 0 in 0.592s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-quobyte-6f4a479f-8a42-4fa7-953b-223e5bbda019" released by "_delete_snapshot" :: held 2.372s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-quobyte-296dab8b-4ab0-433c-9859-115f037ee3e5" released by "delete_snapshot" :: held 2.416s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Created reservations ['b367351f-7479-402e-9077-37933b68589d', 'd6fa051b-9aea-41fb-b078-2169274e671c', '8bcb1443-1dac-44de-81df-8ce9e468e565', '6b20618a-acb7-4af8-9d31-f198f4b441c8'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Delete snapshot completed successfully. Sep 08 19:06:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81eacc33-1198-4cc6-8584-c2c94bb94d40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-6f4a479f-8a42-4fa7-953b-223e5bbda019-delete_snapshot" released by "delete_snapshot" :: held 2.670s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "cinder-296dab8b-4ab0-433c-9859-115f037ee3e5-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-296dab8b-4ab0-433c-9859-115f037ee3e5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "cinder-quobyte-296dab8b-4ab0-433c-9859-115f037ee3e5" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-quobyte-296dab8b-4ab0-433c-9859-115f037ee3e5" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:30 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79df732-df44-45b3-b933-3a25a510508f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:30 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 Sep 08 19:06:30 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:31 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5" returned: 0 in 0.630s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:31 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5 Sep 08 19:06:31 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Acquiring lock "cinder-5ae315ea-4fb7-4166-9e3b-8455ec09b324-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Lock "cinder-5ae315ea-4fb7-4166-9e3b-8455ec09b324-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Acquiring lock "cinder-quobyte-5ae315ea-4fb7-4166-9e3b-8455ec09b324" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-5ae315ea-4fb7-4166-9e3b-8455ec09b324" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3405814-83a0-4a1b-acda-13a24e90cc0f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:31 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-296dab8b-4ab0-433c-9859-115f037ee3e5" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-quobyte-296dab8b-4ab0-433c-9859-115f037ee3e5" released by "delete_volume" :: held 1.191s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:31 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 Sep 08 19:06:31 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Created reservations ['aae017fc-e799-4a86-b422-3f24f2136b61', '79494103-40fb-4ce9-9f45-34f1457f1a63', 'c6f3a54a-24b2-42eb-8cd2-0485519f0804', '4148f93b-467e-463f-b59a-f1994c02eea3'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:32 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:32 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:32 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324" returned: 0 in 0.490s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:32 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324 Sep 08 19:06:32 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:32 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.437s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Deleted volume successfully. Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-60dade18-5b48-4ae1-86d4-8a4821552990 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914762724 None] Lock "cinder-296dab8b-4ab0-433c-9859-115f037ee3e5-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:32 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ae315ea-4fb7-4166-9e3b-8455ec09b324" returned: 0 in 0.415s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-5ae315ea-4fb7-4166-9e3b-8455ec09b324" released by "delete_volume" :: held 0.990s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Created reservations ['a58369c7-f2f0-44f3-8574-7a7c607901a0', '075539af-a519-4d33-b832-514ce5a33c7c', 'f7031296-b712-4fa5-9e91-71e16e5573e0', '899cf0a8-c197-4fc5-9a5e-7d3979971e9c'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:32 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:32 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:33 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.390s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:33 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:33 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Deleted volume successfully. Sep 08 19:06:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e22ae71e-3171-4984-a8cc-63334d0e226e tempest-VolumesExtendTest-1478217891 None] Lock "cinder-5ae315ea-4fb7-4166-9e3b-8455ec09b324-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-677a1448-0b8d-4dfc-a1a0-3977a7f77958 tempest-BackendsCapabilitiesAdminTestsJSON-638454167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4696960449219, 'free_capacity_gb': 1773.4696960449219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87538) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 19:06:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-703580e3-6acb-4d63-9835-af0b10da3f77 tempest-BackendsCapabilitiesAdminTestsJSON-638454167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4696960449219, 'free_capacity_gb': 1773.4696960449219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87538) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:34 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:34 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Flow 'volume_create_manager' (c34b612e-2ef9-4f48-8d79-524b42fbfec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794d0936-ae47-4023-be5d-f56c814c3757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794d0936-ae47-4023-be5d-f56c814c3757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-889663164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dc1454-4a21-49d6-ab0f-5e30b3820e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34f94348ca0446bba466b43f4ac5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:35Z,use_quota=True,user_id='086c4d177b784cba93fabc71b15b845d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc69687-c103-46e4-a4a3-189694f338b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc69687-c103-46e4-a4a3-189694f338b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a0b4e4-ec50-4b55-9989-b01546289dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a0b4e4-ec50-4b55-9989-b01546289dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3dc1454-4a21-49d6-ab0f-5e30b3820e4d', 'volume_name': 'volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826ed68b-c32c-4db2-be63-9fa73feb662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826ed68b-c32c-4db2-be63-9fa73feb662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cf3e0a-0901-447a-ad2c-2566cfeec29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Volume b3dc1454-4a21-49d6-ab0f-5e30b3820e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d', 'volume_size': 1} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-889663164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dc1454-4a21-49d6-ab0f-5e30b3820e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34f94348ca0446bba466b43f4ac5424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:35Z,use_quota=True,user_id='086c4d177b784cba93fabc71b15b845d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Creating volume b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:34 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:34 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d 1073741824 Sep 08 19:06:34 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:34 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.634s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 28 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:06:35 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d 1073741824" returned: 0 in 0.593s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:35 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d Sep 08 19:06:35 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:35 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" returned: 0 in 0.335s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cf3e0a-0901-447a-ad2c-2566cfeec29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37b70b5-b8d7-4ae5-8742-c694bb08d52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Volume volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d (b3dc1454-4a21-49d6-ab0f-5e30b3820e4d): created successfully Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37b70b5-b8d7-4ae5-8742-c694bb08d52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Flow 'volume_create_manager' (c34b612e-2ef9-4f48-8d79-524b42fbfec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-16b42725-e781-450c-baaa-e36f1e98d4ae tempest-VolumesExtendTest-1478217891 None] Created volume successfully. Sep 08 19:06:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Creating offline snapshot e297e247-acdd-4a04-9059-37c00d2b1ae3 of volume b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:06:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e93889d-0c74-429f-af86-4ba1851fa71d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:37 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d Sep 08 19:06:37 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:37 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" returned: 0 in 0.541s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:37 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 1G Sep 08 19:06:37 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:38 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 1G" returned: 0 in 0.581s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:38 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 Sep 08 19:06:38 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:38 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3" returned: 0 in 0.432s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:38 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 is being set with open permissions: ugo+rw Sep 08 19:06:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:38 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 Sep 08 19:06:38 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:38 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3" returned: 0 in 0.289s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:38 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.info Sep 08 19:06:38 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:39 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.info" returned: 0 in 0.373s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:39 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.info is being set with open permissions: ugo+rw Sep 08 19:06:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:39 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.info Sep 08 19:06:39 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:39 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.info" returned: 0 in 0.312s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c4126adf-deb4-47ab-b54d-2adf5c4d1c86 tempest-VolumesExtendTest-1478217891 None] Create snapshot completed successfully Sep 08 19:06:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:40 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab75291-2e82-4077-8251-fb3c18234a02]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:40 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d Sep 08 19:06:40 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:40 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" returned: 0 in 0.525s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 2G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 2G" returned: 0 in 0.153s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.720s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5bcd5912-9885-4868-b664-b5aa5101ea1d tempest-VolumesExtendTest-1478217891 None] Extend volume completed successfully. Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "cinder-e297e247-acdd-4a04-9059-37c00d2b1ae3-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-e297e247-acdd-4a04-9059-37c00d2b1ae3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "cinder-quobyte-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "cinder-quobyte-e297e247-acdd-4a04-9059-37c00d2b1ae3" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-e297e247-acdd-4a04-9059-37c00d2b1ae3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Deleting offline snapshot e297e247-acdd-4a04-9059-37c00d2b1ae3 of volume b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] snapshot_file for this snap is: volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed175a05-6f49-4f2e-905c-8e9edde6d56b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:42 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 Sep 08 19:06:42 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:42 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3" returned: 0 in 0.574s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0c3aa-07c2-49e7-a70f-4022a25bc509]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:42 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d Sep 08 19:06:42 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Flow 'volume_create_manager' (aec421a1-518a-49a7-8ab4-6e1db94b0eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea45416-ae83-456c-9947-c866d4bc6442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea45416-ae83-456c-9947-c866d4bc6442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-557823962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6a18a2-2579-45f0-8fdf-ce0aee878dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23856741c5404d8fb3f42976f9783bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:43Z,use_quota=True,user_id='60ea395c04194682971ac61c3ffc5484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26101997-efbd-4c74-a765-7d430409bef2),volume_type_id=26101997-efbd-4c74-a765-7d430409bef2)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f3b59-6349-4e2a-b4da-1d0ee535dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f3b59-6349-4e2a-b4da-1d0ee535dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74956db-c5fd-4a10-ab24-4ea5e1aae1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74956db-c5fd-4a10-ab24-4ea5e1aae1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6a18a2-2579-45f0-8fdf-ce0aee878dde', 'volume_name': 'volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd137a02-0da8-4a3c-afa7-052903a05b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd137a02-0da8-4a3c-afa7-052903a05b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546f2034-5533-4e87-891b-63605bd0944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:42 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Volume 9c6a18a2-2579-45f0-8fdf-ce0aee878dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde', 'volume_size': 1} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-557823962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6a18a2-2579-45f0-8fdf-ce0aee878dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23856741c5404d8fb3f42976f9783bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:43Z,use_quota=True,user_id='60ea395c04194682971ac61c3ffc5484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26101997-efbd-4c74-a765-7d430409bef2),volume_type_id=26101997-efbd-4c74-a765-7d430409bef2)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Creating volume 9c6a18a2-2579-45f0-8fdf-ce0aee878dde {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:42 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:42 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde 1073741824 Sep 08 19:06:42 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:42 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" returned: 0 in 0.396s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:42 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 Sep 08 19:06:42 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:43 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde 1073741824" returned: 0 in 0.522s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:43 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3" returned: 0 in 0.447s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:43 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3 Sep 08 19:06:43 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:43 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde Sep 08 19:06:43 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:43 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde" returned: 0 in 0.312s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546f2034-5533-4e87-891b-63605bd0944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677abbc7-f208-4591-b755-92fdad4d2e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:43 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d.e297e247-acdd-4a04-9059-37c00d2b1ae3" returned: 0 in 0.375s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:43 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Volume volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde (9c6a18a2-2579-45f0-8fdf-ce0aee878dde): created successfully Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677abbc7-f208-4591-b755-92fdad4d2e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Flow 'volume_create_manager' (aec421a1-518a-49a7-8ab4-6e1db94b0eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5130b915-4afb-4517-bd41-f088700411a0 tempest-VolumeTypesAccessTest-415095561 None] Created volume successfully. Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-e297e247-acdd-4a04-9059-37c00d2b1ae3" released by "_delete_snapshot" :: held 1.972s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" released by "delete_snapshot" :: held 2.006s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Created reservations ['d115f812-1c16-4982-861e-2f3f159c410c', 'b266a224-96ed-4327-a05d-149c91b1212f', '1d54359f-17c6-41d7-8457-d878a2f94143', '3d87923e-181f-4bab-808e-8be9da29ca7b'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Delete snapshot completed successfully. Sep 08 19:06:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-05959d55-252f-4d20-836e-e905d3bc2921 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-e297e247-acdd-4a04-9059-37c00d2b1ae3-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "cinder-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "cinder-quobyte-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" acquired by "delete_volume" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[076388d7-51c3-4334-b271-28db9af6a8bc]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:44 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d Sep 08 19:06:44 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Acquiring lock "cinder-9c6a18a2-2579-45f0-8fdf-ce0aee878dde-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Lock "cinder-9c6a18a2-2579-45f0-8fdf-ce0aee878dde-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Acquiring lock "cinder-quobyte-9c6a18a2-2579-45f0-8fdf-ce0aee878dde" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Lock "cinder-quobyte-9c6a18a2-2579-45f0-8fdf-ce0aee878dde" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b53b6f-fe38-4f1a-8edd-4646e5c1310c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:44 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:44 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde Sep 08 19:06:44 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:44 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d Sep 08 19:06:44 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:44 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" returned: 0 in 0.240s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-quobyte-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d" released by "delete_volume" :: held 0.669s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:45 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde" returned: 0 in 0.395s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:45 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde Sep 08 19:06:45 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Created reservations ['0c131f37-a514-4e3f-8962-5b17a7586ec4', '75d24132-25ee-41f1-9da1-4a9e976cfd4c', 'ae10692d-6a6e-46ea-bd5c-457961637382', '817079ad-dab1-4ba9-835f-2476d84961cc'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:45 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:45 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:45 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c6a18a2-2579-45f0-8fdf-ce0aee878dde" returned: 0 in 0.248s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Lock "cinder-quobyte-9c6a18a2-2579-45f0-8fdf-ce0aee878dde" released by "delete_volume" :: held 0.683s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:45 devstack cinder-volume[87538]: WARNING cinder.quota [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1518509367 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1518509367, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:06:45 devstack cinder-volume[87538]: WARNING cinder.quota [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1518509367 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1518509367, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Created reservations ['d464b9b3-09c6-46f4-a330-ea82d8b97372', '73315c06-a5ad-45ce-8753-75b6cf533e4e', '4bf5f6b3-3ba0-4e8a-b1e2-9afb195333c1', 'b4e93c35-e1d9-499c-a43e-da3e1952c436'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:45 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.259s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Deleted volume successfully. Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f655ec4-0f49-4f55-8b78-7c1b630f76d3 tempest-VolumesExtendTest-1478217891 None] Lock "cinder-b3dc1454-4a21-49d6-ab0f-5e30b3820e4d-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:45 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:45 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:45 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Deleted volume successfully. Sep 08 19:06:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-161afd2f-4ee0-43b1-98aa-7f8ee8619a0b tempest-VolumeTypesAccessTest-415095561 None] Lock "cinder-9c6a18a2-2579-45f0-8fdf-ce0aee878dde-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (4321a90e-dd2b-4093-9b9e-332fd0999286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fcae79-6cb1-4669-9bf5-8f04969a352b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fcae79-6cb1-4669-9bf5-8f04969a352b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758193218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd384b74-a2d2-40e5-beab-439c1587cca0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:50Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa5670d-f5e2-4c30-874b-33e86525f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fa5670d-f5e2-4c30-874b-33e86525f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8506cf-ba45-4d2b-86ae-3f2e922d1650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8506cf-ba45-4d2b-86ae-3f2e922d1650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd384b74-a2d2-40e5-beab-439c1587cca0', 'volume_name': 'volume-bd384b74-a2d2-40e5-beab-439c1587cca0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad10c10d-0de8-41df-a584-01ba1ea0b5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad10c10d-0de8-41df-a584-01ba1ea0b5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c12e806-635c-4d66-adda-bff22c8be6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:50 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Volume bd384b74-a2d2-40e5-beab-439c1587cca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd384b74-a2d2-40e5-beab-439c1587cca0', 'volume_size': 1} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758193218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd384b74-a2d2-40e5-beab-439c1587cca0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:50Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Creating volume bd384b74-a2d2-40e5-beab-439c1587cca0 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:50 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:50 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 1073741824 Sep 08 19:06:50 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:51 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 1073741824" returned: 0 in 0.531s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:51 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 Sep 08 19:06:51 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:51 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0" returned: 0 in 0.285s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c12e806-635c-4d66-adda-bff22c8be6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd384b74-a2d2-40e5-beab-439c1587cca0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d31d64-f9df-4af6-b5bb-fa30a985e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:51 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Volume volume-bd384b74-a2d2-40e5-beab-439c1587cca0 (bd384b74-a2d2-40e5-beab-439c1587cca0): created successfully Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d31d64-f9df-4af6-b5bb-fa30a985e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (4321a90e-dd2b-4093-9b9e-332fd0999286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a6ac3609-c8a5-4ea5-a072-4550a79de558 tempest-VolumesGetTest-883227882 None] Created volume successfully. Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (325f1049-cfdf-4f91-84c9-2248a4814c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf81918-d692-4e07-bb12-6a99ae25938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf81918-d692-4e07-bb12-6a99ae25938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-517051437',display_name='tempest-VolumesGetTest-Volume-399408896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d10e442-1b44-41a9-84fc-22374c9d3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:53Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abb231a-45b8-4fb7-8ba0-a963657a3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abb231a-45b8-4fb7-8ba0-a963657a3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb35dc3-28bf-4da4-8ebf-a51661b28274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb35dc3-28bf-4da4-8ebf-a51661b28274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d10e442-1b44-41a9-84fc-22374c9d3eff', 'volume_name': 'volume-3d10e442-1b44-41a9-84fc-22374c9d3eff', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d62b94-20e2-4dc6-be74-c9e6ca230828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d62b94-20e2-4dc6-be74-c9e6ca230828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f5169b-daa9-476e-8613-3e4ee389a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Volume 3d10e442-1b44-41a9-84fc-22374c9d3eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d10e442-1b44-41a9-84fc-22374c9d3eff', 'volume_size': 1} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-517051437',display_name='tempest-VolumesGetTest-Volume-399408896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d10e442-1b44-41a9-84fc-22374c9d3eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:53Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Creating volume 3d10e442-1b44-41a9-84fc-22374c9d3eff {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:53 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:53 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff 1073741824 Sep 08 19:06:53 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:54 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff 1073741824" returned: 0 in 0.648s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:54 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff Sep 08 19:06:54 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Flow 'volume_create_manager' (df13a46e-a37a-40a9-99ee-cde7db62890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bceef5-bfdc-4999-9012-e0947a3c8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bceef5-bfdc-4999-9012-e0947a3c8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1121374331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d39f2f-1512-48cb-a546-c74053103893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72330bf3ee84ce1a574a394de6965c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:54Z,use_quota=True,user_id='588e2743325d4809a4f0f5c0ba05f53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49538c11-e2d5-4232-8c48-ac00569b35f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49538c11-e2d5-4232-8c48-ac00569b35f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e48f63-1778-4dc8-a840-b6bf034e3df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e48f63-1778-4dc8-a840-b6bf034e3df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d39f2f-1512-48cb-a546-c74053103893', 'volume_name': 'volume-10d39f2f-1512-48cb-a546-c74053103893', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce832cc-bea1-45e7-b794-753f4f008ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce832cc-bea1-45e7-b794-753f4f008ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df6ecda-0c1b-4a9f-8c05-0fae0646189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:54 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Volume 10d39f2f-1512-48cb-a546-c74053103893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d39f2f-1512-48cb-a546-c74053103893', 'volume_size': 1} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:54 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff" returned: 0 in 0.326s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1121374331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d39f2f-1512-48cb-a546-c74053103893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72330bf3ee84ce1a574a394de6965c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:54Z,use_quota=True,user_id='588e2743325d4809a4f0f5c0ba05f53f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Creating volume 10d39f2f-1512-48cb-a546-c74053103893 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:54 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:54 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 1073741824 Sep 08 19:06:54 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f5169b-daa9-476e-8613-3e4ee389a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d10e442-1b44-41a9-84fc-22374c9d3eff', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3082af26-6667-40c0-bebe-0b28501b0401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:54 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Volume volume-3d10e442-1b44-41a9-84fc-22374c9d3eff (3d10e442-1b44-41a9-84fc-22374c9d3eff): created successfully Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3082af26-6667-40c0-bebe-0b28501b0401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (325f1049-cfdf-4f91-84c9-2248a4814c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:54 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2e9784b3-a962-434e-aba3-883734623c76 tempest-VolumesGetTest-883227882 None] Created volume successfully. Sep 08 19:06:55 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 1073741824" returned: 0 in 0.543s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:55 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 Sep 08 19:06:55 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:55 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893" returned: 0 in 0.372s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3df6ecda-0c1b-4a9f-8c05-0fae0646189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d39f2f-1512-48cb-a546-c74053103893', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a83e5c-2bff-476c-a208-3e1decfe5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:55 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Volume volume-10d39f2f-1512-48cb-a546-c74053103893 (10d39f2f-1512-48cb-a546-c74053103893): created successfully Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a83e5c-2bff-476c-a208-3e1decfe5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Flow 'volume_create_manager' (df13a46e-a37a-40a9-99ee-cde7db62890f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-183bb7e3-3187-4068-86f1-4d42696d5654 tempest-AttachVolumeShelveTestJSON-289772527 None] Created volume successfully. Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-3d10e442-1b44-41a9-84fc-22374c9d3eff-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Lock "cinder-3d10e442-1b44-41a9-84fc-22374c9d3eff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-3d10e442-1b44-41a9-84fc-22374c9d3eff" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-3d10e442-1b44-41a9-84fc-22374c9d3eff" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4313fe9-c384-41dd-b5ca-2b9ffc4e35f9]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:56 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff Sep 08 19:06:56 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:56 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff" returned: 0 in 0.447s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:56 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff Sep 08 19:06:56 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:56 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3d10e442-1b44-41a9-84fc-22374c9d3eff" returned: 0 in 0.385s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-3d10e442-1b44-41a9-84fc-22374c9d3eff" released by "delete_volume" :: held 0.898s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:56 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Created reservations ['cd8a3cd0-c584-4fd0-b4aa-894795a14d16', '293022fe-ba33-4a5a-9b79-9b62e68b3eac', '7f933147-3c14-46a9-a26e-225fa733c08e', '2a2d5c31-b121-433f-b814-cb37c0a646e2'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:57 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:57 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-bd384b74-a2d2-40e5-beab-439c1587cca0-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Lock "cinder-bd384b74-a2d2-40e5-beab-439c1587cca0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-bd384b74-a2d2-40e5-beab-439c1587cca0" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-bd384b74-a2d2-40e5-beab-439c1587cca0" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:06:57 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.347s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:57 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Deleted volume successfully. Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[284f4583-8936-4a4e-b7d9-8922c1854419]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5919872-259b-47af-81f7-034529dfa121 tempest-VolumesGetTest-883227882 None] Lock "cinder-3d10e442-1b44-41a9-84fc-22374c9d3eff-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:57 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 Sep 08 19:06:57 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:57 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0" returned: 0 in 0.520s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:58 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0 Sep 08 19:06:58 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:58 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bd384b74-a2d2-40e5-beab-439c1587cca0" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-bd384b74-a2d2-40e5-beab-439c1587cca0" released by "delete_volume" :: held 0.909s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Created reservations ['c63779f0-d801-4705-abec-8de7fbe5f838', '8697d713-9b5d-40a5-9148-6c6201cf0634', '610fc405-7f05-47b8-b219-1fc4e0683821', '94347cb2-62fa-4ba5-9cd6-23bdac9b9935'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:58 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:06:58 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:06:58 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.453s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:06:58 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:06:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Deleted volume successfully. Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aa3ab967-6b8f-420a-b09d-250156c59621 tempest-VolumesGetTest-883227882 None] Lock "cinder-bd384b74-a2d2-40e5-beab-439c1587cca0-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (e3565c59-f803-456e-af17-d219880e37ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a81587-f3b8-489b-8e2b-91c7ff0dd3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a81587-f3b8-489b-8e2b-91c7ff0dd3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-549908042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601f29d2-1332-4dfb-b36f-cec950fb772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:59Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6e36c9-8679-46f8-8ac8-57068c58b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6e36c9-8679-46f8-8ac8-57068c58b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc81bc9-bb00-402f-97f3-18d9b5e94115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc81bc9-bb00-402f-97f3-18d9b5e94115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '601f29d2-1332-4dfb-b36f-cec950fb772c', 'volume_name': 'volume-601f29d2-1332-4dfb-b36f-cec950fb772c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e834e-f254-4dc6-b0a3-3f63225ef291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1e834e-f254-4dc6-b0a3-3f63225ef291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd6d004-b95f-41a0-8fca-e00fa262b9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:06:59 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Volume 601f29d2-1332-4dfb-b36f-cec950fb772c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-601f29d2-1332-4dfb-b36f-cec950fb772c', 'volume_size': 1} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-549908042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=601f29d2-1332-4dfb-b36f-cec950fb772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:06:59Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Creating volume 601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:06:59 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:06:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:06:59 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c 1073741824 Sep 08 19:06:59 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:00 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c 1073741824" returned: 0 in 0.681s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:00 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c Sep 08 19:07:00 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:00 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c" returned: 0 in 0.410s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd6d004-b95f-41a0-8fca-e00fa262b9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-601f29d2-1332-4dfb-b36f-cec950fb772c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ef24af-609c-4efb-b0a2-0be0a34d69d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:00 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Volume volume-601f29d2-1332-4dfb-b36f-cec950fb772c (601f29d2-1332-4dfb-b36f-cec950fb772c): created successfully Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ef24af-609c-4efb-b0a2-0be0a34d69d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (e3565c59-f803-456e-af17-d219880e37ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-af038671-5437-4095-bdaa-104b4f12a9af tempest-VolumesGetTest-883227882 None] Created volume successfully. Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (d6585748-50c9-4c9c-bb28-7abf93f31fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1843a39-1f27-4c93-ac4e-cd4b63918e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1843a39-1f27-4c93-ac4e-cd4b63918e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-751721267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0249e0a-c18b-4835-85b3-8abdf9fa1c97,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=601f29d2-1332-4dfb-b36f-cec950fb772c,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:02Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e013d9e-9cab-4499-848f-b290c75ea999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e013d9e-9cab-4499-848f-b290c75ea999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da995e66-76d0-46b0-a40f-be1bb0af5506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da995e66-76d0-46b0-a40f-be1bb0af5506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a0249e0a-c18b-4835-85b3-8abdf9fa1c97', 'volume_name': 'volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97', 'volume_size': 1, 'source_volid': '601f29d2-1332-4dfb-b36f-cec950fb772c', 'source_volstatus': 'available'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1c7bb9-505b-4f38-a53d-80162729dd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1c7bb9-505b-4f38-a53d-80162729dd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac1b731-e099-4dfa-9696-9aace669297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Volume a0249e0a-c18b-4835-85b3-8abdf9fa1c97: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97', 'volume_size': 1, 'source_volid': '601f29d2-1332-4dfb-b36f-cec950fb772c', 'source_volstatus': 'available'} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:02 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Cloning volume 601f29d2-1332-4dfb-b36f-cec950fb772c to volume a0249e0a-c18b-4835-85b3-8abdf9fa1c97 Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Creating offline snapshot e9ac22ab-67b8-4b10-9b59-ad1cbae43225 of volume 601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1cb73-188a-421d-8003-ce3369c0fa60]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:02 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c Sep 08 19:07:02 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:03 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c" returned: 0 in 0.480s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:03 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 1G Sep 08 19:07:03 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:03 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 1G" returned: 0 in 0.667s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-601f29d2-1332-4dfb-b36f-cec950fb772c -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:03 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-601f29d2-1332-4dfb-b36f-cec950fb772c -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 Sep 08 19:07:03 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:04 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-601f29d2-1332-4dfb-b36f-cec950fb772c -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225" returned: 0 in 0.425s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:04 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 is being set with open permissions: ugo+rw Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:04 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 Sep 08 19:07:04 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Flow 'volume_create_manager' (cbec4e9b-9713-472d-967b-78282deee5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8048aa1b-1158-4fc2-b39c-07424e15d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8048aa1b-1158-4fc2-b39c-07424e15d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1235566477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f261c18-cf76-4ef1-a9b7-430dc3fff041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f36a2152440219922320c08df144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:04Z,use_quota=True,user_id='07afdc9ea8fd4113804397ed79102eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e18f36a-380a-496a-a2fa-94a651119b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e18f36a-380a-496a-a2fa-94a651119b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447a80e6-8129-4737-810d-dee401264525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447a80e6-8129-4737-810d-dee401264525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f261c18-cf76-4ef1-a9b7-430dc3fff041', 'volume_name': 'volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74a8def-f371-47d2-b0c7-abfb0e323a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74a8def-f371-47d2-b0c7-abfb0e323a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd80b31-4759-4c37-9b06-cd8ccc0bfc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Volume 7f261c18-cf76-4ef1-a9b7-430dc3fff041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041', 'volume_size': 1} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:04 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225" returned: 0 in 0.439s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:04 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.info Sep 08 19:07:04 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:05 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.info" returned: 0 in 0.391s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:05 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.info is being set with open permissions: ugo+rw Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:05 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.info Sep 08 19:07:05 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:05 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.info" returned: 0 in 0.365s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] snapshot: e9ac22ab-67b8-4b10-9b59-ad1cbae43225, volume: a0249e0a-c18b-4835-85b3-8abdf9fa1c97, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb798048-be81-4999-8205-cfb2aa1691e6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:05 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 Sep 08 19:07:05 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:05 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-601f29d2-1332-4dfb-b36f-cec950fb772c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca06689-a74f-45d0-8a61-215754752eee]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:06 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c Sep 08 19:07:06 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:06 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:07:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:07:06 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:07:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:06 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 Sep 08 19:07:06 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-df62cddd-7af1-422b-a776-99f48ce6797f req-247ef2da-0daf-4b40-9e90-85543cf19a5b tempest-AttachVolumeShelveTestJSON-289772527 None] No connector for attachment e7c7405a-316c-4cd3-9180-c52b05f96a02; skipping storage backend terminate_connection call. {{(pid=87538) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 08 19:07:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-df62cddd-7af1-422b-a776-99f48ce6797f req-247ef2da-0daf-4b40-9e90-85543cf19a5b tempest-AttachVolumeShelveTestJSON-289772527 None] Deleting attachment e7c7405a-316c-4cd3-9180-c52b05f96a02. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:07:12 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" returned: 0 in 5.730s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:07:12 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Converted 1024.00 MB image at 178.63 MB/s Sep 08 19:07:12 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 is being set with open permissions: ugo+rw Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:12 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 Sep 08 19:07:12 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:12 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" released by "_copy_volume_from_snapshot" :: held 6.926s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-e9ac22ab-67b8-4b10-9b59-ad1cbae43225" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-e9ac22ab-67b8-4b10-9b59-ad1cbae43225" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Deleting offline snapshot e9ac22ab-67b8-4b10-9b59-ad1cbae43225 of volume 601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] snapshot_file for this snap is: volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51252a-a5c6-4de6-bee6-847960572336]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:12 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 Sep 08 19:07:12 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:12 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225" returned: 0 in 0.444s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-601f29d2-1332-4dfb-b36f-cec950fb772c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[051beab5-b2ce-4ccd-93fe-85b91f06cca4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:13 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c Sep 08 19:07:13 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:13 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c" returned: 0 in 0.666s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:13 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 Sep 08 19:07:13 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:14 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225" returned: 0 in 0.449s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:14 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225 Sep 08 19:07:14 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:14 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c.e9ac22ab-67b8-4b10-9b59-ad1cbae43225" returned: 0 in 0.326s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-e9ac22ab-67b8-4b10-9b59-ad1cbae43225" released by "_delete_snapshot" :: held 2.041s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.034s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1235566477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f261c18-cf76-4ef1-a9b7-430dc3fff041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f36a2152440219922320c08df144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:04Z,use_quota=True,user_id='07afdc9ea8fd4113804397ed79102eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Creating volume 7f261c18-cf76-4ef1-a9b7-430dc3fff041 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:14 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:14 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 1073741824 Sep 08 19:07:14 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac1b731-e099-4dfa-9696-9aace669297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97', 'volume_size': 1, 'source_volid': '601f29d2-1332-4dfb-b36f-cec950fb772c', 'source_volstatus': 'available'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40054b50-3708-4f94-b1f0-5794f3e5f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:14 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Volume volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 (a0249e0a-c18b-4835-85b3-8abdf9fa1c97): created successfully Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40054b50-3708-4f94-b1f0-5794f3e5f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (d6585748-50c9-4c9c-bb28-7abf93f31fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:14 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-30c55b15-967a-43aa-aa8d-d74f9addad92 tempest-VolumesGetTest-883227882 None] Created volume successfully. Sep 08 19:07:15 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 1073741824" returned: 0 in 0.525s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:15 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 Sep 08 19:07:15 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:15 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041" returned: 0 in 0.296s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd80b31-4759-4c37-9b06-cd8ccc0bfc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50191a9a-23ab-408c-82fd-16ab3f627226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:15 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Volume volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 (7f261c18-cf76-4ef1-a9b7-430dc3fff041): created successfully Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50191a9a-23ab-408c-82fd-16ab3f627226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Flow 'volume_create_manager' (cbec4e9b-9713-472d-967b-78282deee5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3473e8e6-251f-42ce-acc7-444395b2555e tempest-VolumeQuotasAdminTestJSON-1120469047 None] Created volume successfully. Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Acquiring lock "cinder-7f261c18-cf76-4ef1-a9b7-430dc3fff041-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "cinder-7f261c18-cf76-4ef1-a9b7-430dc3fff041-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Acquiring lock "cinder-quobyte-7f261c18-cf76-4ef1-a9b7-430dc3fff041" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "cinder-quobyte-7f261c18-cf76-4ef1-a9b7-430dc3fff041" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ba962-a8a3-44c0-b08a-29629048621d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:16 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 Sep 08 19:07:16 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:16 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041" returned: 0 in 0.502s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:16 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041 Sep 08 19:07:16 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:16 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f261c18-cf76-4ef1-a9b7-430dc3fff041" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "cinder-quobyte-7f261c18-cf76-4ef1-a9b7-430dc3fff041" released by "delete_volume" :: held 1.003s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:16 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (d04a901d-b9cb-42ba-8347-a313bf49ecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1941f2a-b15c-4b3f-bcc5-08e7886a1263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1941f2a-b15c-4b3f-bcc5-08e7886a1263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1794773778',display_name='tempest-VolumesGetTest-Volume-1115579686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e74db8-fd18-47e0-9d3f-a6425b586ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:17Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5484eb14-d531-455f-b445-c9689f35941e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5484eb14-d531-455f-b445-c9689f35941e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc60880-c4ad-48e8-b5b8-7d90c810271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc60880-c4ad-48e8-b5b8-7d90c810271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e74db8-fd18-47e0-9d3f-a6425b586ee6', 'volume_name': 'volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825b0b09-74ca-4001-94b1-9470f6c60182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825b0b09-74ca-4001-94b1-9470f6c60182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e107fe6-8615-4417-8801-29e88bc8473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:17 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Volume 90e74db8-fd18-47e0-9d3f-a6425b586ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6', 'volume_size': 1} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1794773778',display_name='tempest-VolumesGetTest-Volume-1115579686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e74db8-fd18-47e0-9d3f-a6425b586ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:17Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Creating volume 90e74db8-fd18-47e0-9d3f-a6425b586ee6 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:17 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:17 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 1073741824 Sep 08 19:07:17 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Created reservations ['c0eff4a5-2746-46c6-b687-b69b756d63a8', '7972e07f-7163-44d3-8145-de0b64340225', '61fb1d05-cec9-47df-83b5-f14a1b7c95c8', 'a63c8aec-3a17-4613-ad6a-49e103653dfc'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:17 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:17 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:17 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:17 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Deleted volume successfully. Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-90fceb6b-9d40-4399-9233-c45b20912329 tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "cinder-7f261c18-cf76-4ef1-a9b7-430dc3fff041-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:17 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 1073741824" returned: 0 in 0.605s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:17 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 Sep 08 19:07:17 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:18 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6" returned: 0 in 0.355s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e107fe6-8615-4417-8801-29e88bc8473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cd099c-9aef-482d-a328-6b6002e47b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:18 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Volume volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 (90e74db8-fd18-47e0-9d3f-a6425b586ee6): created successfully Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cd099c-9aef-482d-a328-6b6002e47b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (d04a901d-b9cb-42ba-8347-a313bf49ecd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:18 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-659c02db-deb0-4e66-97d8-aa3377a5c7a7 tempest-VolumesGetTest-883227882 None] Created volume successfully. Sep 08 19:07:18 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Flow 'volume_create_manager' (e652707c-c443-44f2-a669-1dd1fc14bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e98058-6cc8-495e-8cfc-6211c0f6b36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e98058-6cc8-495e-8cfc-6211c0f6b36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1972289899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aedaa481-f0ec-47c0-8f83-b10cc0455f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f36a2152440219922320c08df144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:19Z,use_quota=True,user_id='07afdc9ea8fd4113804397ed79102eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a5fc98-dd42-4ddd-9ba9-61aabbeae9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a5fc98-dd42-4ddd-9ba9-61aabbeae9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656c555e-b629-47fc-9449-2f19c9ca5df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656c555e-b629-47fc-9449-2f19c9ca5df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aedaa481-f0ec-47c0-8f83-b10cc0455f51', 'volume_name': 'volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8e12d-16ba-432b-9fc9-59c006db10be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8e12d-16ba-432b-9fc9-59c006db10be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc1b304-acef-40ff-be28-700cc0d3e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:19 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Volume aedaa481-f0ec-47c0-8f83-b10cc0455f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51', 'volume_size': 1} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1972289899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aedaa481-f0ec-47c0-8f83-b10cc0455f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0f36a2152440219922320c08df144b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:19Z,use_quota=True,user_id='07afdc9ea8fd4113804397ed79102eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Creating volume aedaa481-f0ec-47c0-8f83-b10cc0455f51 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:19 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:19 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 1073741824 Sep 08 19:07:19 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-90e74db8-fd18-47e0-9d3f-a6425b586ee6-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Lock "cinder-90e74db8-fd18-47e0-9d3f-a6425b586ee6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-90e74db8-fd18-47e0-9d3f-a6425b586ee6" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-90e74db8-fd18-47e0-9d3f-a6425b586ee6" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6cfac9-a38c-4db3-b99b-495c0c1fd9c4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:19 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 Sep 08 19:07:19 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:19 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 1073741824" returned: 0 in 0.702s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:20 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 Sep 08 19:07:20 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:20 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6" returned: 0 in 0.749s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:20 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51" returned: 0 in 0.423s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:20 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6 Sep 08 19:07:20 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc1b304-acef-40ff-be28-700cc0d3e010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa3f386-47aa-4c44-ada7-ef8a94ded97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:20 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Volume volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 (aedaa481-f0ec-47c0-8f83-b10cc0455f51): created successfully Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa3f386-47aa-4c44-ada7-ef8a94ded97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Flow 'volume_create_manager' (e652707c-c443-44f2-a669-1dd1fc14bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-744cb06a-597c-447d-8857-bb29b0d852ee tempest-VolumeQuotasAdminTestJSON-1120469047 None] Created volume successfully. Sep 08 19:07:20 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-90e74db8-fd18-47e0-9d3f-a6425b586ee6" returned: 0 in 0.592s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-90e74db8-fd18-47e0-9d3f-a6425b586ee6" released by "delete_volume" :: held 1.426s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:20 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Created reservations ['07377523-5fb9-45d9-8be5-609427ef6b37', '5547c750-cf71-425d-a390-efcbba811f3b', '71718c27-2650-4408-81e4-b9319d9c315d', 'f5b72ae4-e3e5-4b4b-8656-d463d377e6f3'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:21 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:21 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:21 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.410s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:21 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Deleted volume successfully. Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d266a890-58e7-4bb7-9d78-7c572ed9628d tempest-VolumesGetTest-883227882 None] Lock "cinder-90e74db8-fd18-47e0-9d3f-a6425b586ee6-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-a0249e0a-c18b-4835-85b3-8abdf9fa1c97-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Lock "cinder-a0249e0a-c18b-4835-85b3-8abdf9fa1c97-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bba3233c-7aca-4dcd-8c5c-17fbab74500d tempest-VolumeQuotasAdminTestJSON-431288434 None] Transfer volume completed successfully. Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[550b739e-2405-4f54-b9f9-ffa79c507359]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:22 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 Sep 08 19:07:22 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Acquiring lock "cinder-aedaa481-f0ec-47c0-8f83-b10cc0455f51-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:22 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" returned: 0 in 0.539s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Lock "cinder-aedaa481-f0ec-47c0-8f83-b10cc0455f51-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:22 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97 Sep 08 19:07:22 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Acquiring lock "cinder-quobyte-aedaa481-f0ec-47c0-8f83-b10cc0455f51" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Lock "cinder-quobyte-aedaa481-f0ec-47c0-8f83-b10cc0455f51" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e50bb6e-6d6b-4b3d-8851-e9a6923fc6cf]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:22 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 Sep 08 19:07:22 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:22 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-a0249e0a-c18b-4835-85b3-8abdf9fa1c97" released by "delete_volume" :: held 0.911s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Created reservations ['8733cb15-ab34-49e0-92e8-808b276464ac', '9a1f24f3-6570-40e0-895a-4a7926e9bf4d', '8d69019f-4942-4bd2-a62a-e438cd348ed1', '9d3f27d0-524a-44f4-a8a9-4d2c1d91eb92'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:23 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:23 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-601f29d2-1332-4dfb-b36f-cec950fb772c-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Lock "cinder-601f29d2-1332-4dfb-b36f-cec950fb772c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:23 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51" returned: 0 in 0.565s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-601f29d2-1332-4dfb-b36f-cec950fb772c" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-601f29d2-1332-4dfb-b36f-cec950fb772c" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:23 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51 Sep 08 19:07:23 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff9fdb-85b3-4d60-a015-63b7a0b874ae]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:23 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c Sep 08 19:07:23 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:23 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.654s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Deleted volume successfully. Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-156e1b41-5f61-48e8-adc2-f0f0f6f8d134 tempest-VolumesGetTest-883227882 None] Lock "cinder-a0249e0a-c18b-4835-85b3-8abdf9fa1c97-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:23 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aedaa481-f0ec-47c0-8f83-b10cc0455f51" returned: 0 in 0.522s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Lock "cinder-quobyte-aedaa481-f0ec-47c0-8f83-b10cc0455f51" released by "delete_volume" :: held 1.162s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:23 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Created reservations ['531966a5-2b5e-4429-a063-40d166d25341', 'e586e7dd-07dd-4c51-b3ea-0b91efb223c9', '5a75792f-c4e4-4d8c-b908-a95606b44042', '079a45dc-650b-4bf7-adc6-74f8ceec0eb7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:24 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c" returned: 0 in 0.574s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:24 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c Sep 08 19:07:24 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:24 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:24 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:24 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-601f29d2-1332-4dfb-b36f-cec950fb772c" returned: 0 in 0.304s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-601f29d2-1332-4dfb-b36f-cec950fb772c" released by "delete_volume" :: held 0.971s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:24 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Deleted volume successfully. Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Created reservations ['78e8eb53-7fa6-4ce6-a710-59e9b35eac5d', '159ca055-d02b-4e06-94cc-4a83fb71381b', '0f2dd739-c1d2-493e-9e8e-0f5ada3c45a6', '73f4a95c-31e8-4edf-8223-f627367065aa'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0f211da5-3d7c-4eef-8f3c-9671cd93f162 tempest-VolumeQuotasAdminTestJSON-1210582356 None] Lock "cinder-aedaa481-f0ec-47c0-8f83-b10cc0455f51-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:24 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:24 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:24 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.334s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:24 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Deleted volume successfully. Sep 08 19:07:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b6fe61b6-1b24-441e-9933-aebc35710d21 tempest-VolumesGetTest-883227882 None] Lock "cinder-601f29d2-1332-4dfb-b36f-cec950fb772c-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=111,cinder:INSERT=39,cinder:UPDATE=134,cinder:DELETE=10 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:INSERT=38,cinder:SELECT=97,cinder:UPDATE=145,cinder:DELETE=13 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (4c9981f9-305b-4d0f-b920-e92e8ce81205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3ec59c-c188-44d3-b035-28a05b6fb889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3ec59c-c188-44d3-b035-28a05b6fb889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1621217323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:28Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074d7781-6933-4784-ab8d-74961b055ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074d7781-6933-4784-ab8d-74961b055ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99653b12-c817-47e7-8328-699253994349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:27 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:07:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99653b12-c817-47e7-8328-699253994349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5', 'volume_name': 'volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c466b7d3-a94a-4409-b504-8217d7621208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c466b7d3-a94a-4409-b504-8217d7621208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727b8346-1516-4f2a-aac4-c5eda4885287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Volume 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:07:28 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Trying to clone 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 from image 8499e13e-f314-4011-953c-7c51abb2061c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:07:29 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:07:29 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:07:29 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1cabd4-37a2-46e7-9a96-38ece4ce9840]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:29 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD Sep 08 19:07:29 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:29 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:29 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c is fetched for user 22862c796cda46778974e190d772f0a0. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:07:29 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae11e2a-d089-45c4-a173-a9244651e103]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:30 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD Sep 08 19:07:30 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:30 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1621217323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:28Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Creating volume 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:30 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:30 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 1073741824 Sep 08 19:07:30 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:31 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 1073741824" returned: 0 in 1.034s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:31 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 Sep 08 19:07:31 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:32 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5" returned: 0 in 0.504s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:32 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Attempting download of 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:07:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd86cf8-3bca-4e11-abe9-f31208e1746d]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_md88zckx {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:32 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_md88zckx Sep 08 19:07:32 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:33 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_md88zckx" returned: 0 in 0.602s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_md88zckx {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:33 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_md88zckx Sep 08 19:07:33 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:33 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_md88zckx" returned: 1 in 0.623s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_md88zckx' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:07:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afde37a-574a-4c07-8379-236c7858aa65]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:33 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD Sep 08 19:07:33 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:34 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] 8499e13e-f314-4011-953c-7c51abb2061c was qcow2, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:34 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:34 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:34 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 Sep 08 19:07:34 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:34 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.565s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 28 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:07:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (d48c4cfe-6132-49a9-8109-ef27fef4b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c039eb-7861-4a56-aa32-cad9379c9fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c039eb-7861-4a56-aa32-cad9379c9fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1904739388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8b88cb-995e-4173-916b-47d029524d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:37Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81d0ef1-39b8-40d2-8861-fffe1c79384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81d0ef1-39b8-40d2-8861-fffe1c79384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e0ce94-2b85-4902-98ba-75c0ec685d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e0ce94-2b85-4902-98ba-75c0ec685d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8b88cb-995e-4173-916b-47d029524d17', 'volume_name': 'volume-9a8b88cb-995e-4173-916b-47d029524d17', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf7fadc-159f-43f1-bb01-41fb2aa51ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf7fadc-159f-43f1-bb01-41fb2aa51ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b09fdb8-f035-42d8-8bda-57ce50fa4771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Volume 9a8b88cb-995e-4173-916b-47d029524d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8b88cb-995e-4173-916b-47d029524d17', 'volume_size': 1} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1904739388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8b88cb-995e-4173-916b-47d029524d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:37Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Creating volume 9a8b88cb-995e-4173-916b-47d029524d17 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:36 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:36 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 1073741824 Sep 08 19:07:36 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:37 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5" returned: 0 in 2.935s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_7jjk0k8ndevstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:07:37 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Converted 112.00 MB image at 38.04 MB/s Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:37 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:37 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 1G Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 1073741824" returned: 0 in 0.613s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:37 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:37 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 Sep 08 19:07:37 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:37 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 1G" returned: 0 in 0.571s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Downloaded image 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c for user 22862c796cda46778974e190d772f0a0 is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Marking volume 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Copying metadata from image 8499e13e-f314-4011-953c-7c51abb2061c to 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:07:37 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Creating volume glance metadata for volume 3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 backed by image 8499e13e-f314-4011-953c-7c51abb2061c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (727b8346-1516-4f2a-aac4-c5eda4885287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:38 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77ef92e-5a1f-496e-9eb0-806e83d2f32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17" returned: 0 in 0.454s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b09fdb8-f035-42d8-8bda-57ce50fa4771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8b88cb-995e-4173-916b-47d029524d17', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64366c2c-4e29-4ff1-a597-87edb14c66ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:38 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Volume volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 (3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5): created successfully Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77ef92e-5a1f-496e-9eb0-806e83d2f32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (4c9981f9-305b-4d0f-b920-e92e8ce81205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:38 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Volume volume-9a8b88cb-995e-4173-916b-47d029524d17 (9a8b88cb-995e-4173-916b-47d029524d17): created successfully Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64366c2c-4e29-4ff1-a597-87edb14c66ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (d48c4cfe-6132-49a9-8109-ef27fef4b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ef71e855-e9b7-44d6-a1c5-924e2d08c942 tempest-VolumesGetTest-883227882 None] Created volume successfully. Sep 08 19:07:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3b225fb7-fbc2-4457-b7df-1724e7770583 tempest-VolumesActionsTest-1338526523 None] Created volume successfully. Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-411f5bde-460d-4add-bd2a-a5c4a8713f4a tempest-VolumesActionsTest-1338526523 None] Acquiring lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17" by "attach_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-411f5bde-460d-4add-bd2a-a5c4a8713f4a tempest-VolumesActionsTest-1338526523 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17" acquired by "attach_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-411f5bde-460d-4add-bd2a-a5c4a8713f4a tempest-VolumesActionsTest-1338526523 None] Attaching volume 9a8b88cb-995e-4173-916b-47d029524d17 to instance a3ea9d00-d0be-4d87-b5a9-3925d4ac59f3 at mountpoint /dev/vdb on host None. Sep 08 19:07:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-411f5bde-460d-4add-bd2a-a5c4a8713f4a tempest-VolumesActionsTest-1338526523 None] Attach volume completed successfully. Sep 08 19:07:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-411f5bde-460d-4add-bd2a-a5c4a8713f4a tempest-VolumesActionsTest-1338526523 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17" released by "attach_volume" :: held 0.224s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (7d96852a-1a9e-40a3-aa78-83a88031406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4ac0f6-879b-4194-91ca-d5f9a7dfed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4ac0f6-879b-4194-91ca-d5f9a7dfed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1372903618',display_name='tempest-VolumesGetTest-Volume-991145041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3986ce5-c9be-4d27-9c12-4105e98df2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:40Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7802eaee-b368-4195-86f4-5a20a84a2496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7802eaee-b368-4195-86f4-5a20a84a2496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcc2e9c-fc38-42c7-8ae1-ed69b1c63492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afcc2e9c-fc38-42c7-8ae1-ed69b1c63492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3986ce5-c9be-4d27-9c12-4105e98df2c6', 'volume_name': 'volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a476e41f-6b36-44d7-a106-76303d41812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a476e41f-6b36-44d7-a106-76303d41812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bae0427-fc99-4fdf-94ca-943163559fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Volume b3986ce5-c9be-4d27-9c12-4105e98df2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6', 'volume_size': 1} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1372903618',display_name='tempest-VolumesGetTest-Volume-991145041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3986ce5-c9be-4d27-9c12-4105e98df2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02a5691ddff42f6ad6e4c38ed268c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:40Z,use_quota=True,user_id='22862c796cda46778974e190d772f0a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Creating volume b3986ce5-c9be-4d27-9c12-4105e98df2c6 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:40 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:40 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 1073741824 Sep 08 19:07:40 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e24129eb-2571-4663-a155-2f29df3a2f19 tempest-VolumesActionsTest-1118478353 None] Terminate volume connection completed successfully. Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e24129eb-2571-4663-a155-2f29df3a2f19 tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-detach_volume" by "detach_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e24129eb-2571-4663-a155-2f29df3a2f19 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e24129eb-2571-4663-a155-2f29df3a2f19 tempest-VolumesActionsTest-1118478353 None] Detaching volume 9a8b88cb-995e-4173-916b-47d029524d17 from instance a3ea9d00-d0be-4d87-b5a9-3925d4ac59f3. Sep 08 19:07:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e24129eb-2571-4663-a155-2f29df3a2f19 tempest-VolumesActionsTest-1118478353 None] Detach volume completed successfully. Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e24129eb-2571-4663-a155-2f29df3a2f19 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-detach_volume" released by "detach_volume" :: held 0.137s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59c3b779-b14f-4d6e-a983-00f1a2ee0f1f tempest-VolumesActionsTest-1338526523 None] Acquiring lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-detach_volume" by "detach_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59c3b779-b14f-4d6e-a983-00f1a2ee0f1f tempest-VolumesActionsTest-1338526523 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-59c3b779-b14f-4d6e-a983-00f1a2ee0f1f tempest-VolumesActionsTest-1338526523 None] Volume detach called, but volume not attached. Sep 08 19:07:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59c3b779-b14f-4d6e-a983-00f1a2ee0f1f tempest-VolumesActionsTest-1338526523 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:41 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 1073741824" returned: 0 in 0.847s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:41 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 Sep 08 19:07:41 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Acquiring lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Acquiring lock "cinder-quobyte-9a8b88cb-995e-4173-916b-47d029524d17" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Lock "cinder-quobyte-9a8b88cb-995e-4173-916b-47d029524d17" acquired by "delete_volume" :: waited 0.072s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ea4f04-172d-446c-a348-198fdbe924d9]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:41 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6" returned: 0 in 0.449s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bae0427-fc99-4fdf-94ca-943163559fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8c5194-6ec7-46b9-9744-b76b9ba6c9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:41 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Volume volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 (b3986ce5-c9be-4d27-9c12-4105e98df2c6): created successfully Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8c5194-6ec7-46b9-9744-b76b9ba6c9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Flow 'volume_create_manager' (7d96852a-1a9e-40a3-aa78-83a88031406d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1b5a61ad-5b46-4c56-9021-80fccb4c9a3c tempest-VolumesGetTest-883227882 None] Created volume successfully. Sep 08 19:07:41 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 Sep 08 19:07:41 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Flow 'volume_create_manager' (2c0da547-e949-4a38-a40a-ef2f2ba4e5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59189eea-01f1-46a7-b808-08ffa3a32e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59189eea-01f1-46a7-b808-08ffa3a32e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1656539252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb27db61-f254-4e45-8acd-8e23e2ffe9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111484d3f4104b319898a9a15c0bbab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:42Z,use_quota=True,user_id='66488036913c48deb76daf851caadbc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89327ebd-c48c-4cfd-a3d2-b3dba3ebbd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89327ebd-c48c-4cfd-a3d2-b3dba3ebbd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af6888f-42a7-4add-bfe4-08b6c558fbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af6888f-42a7-4add-bfe4-08b6c558fbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb27db61-f254-4e45-8acd-8e23e2ffe9bf', 'volume_name': 'volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9deae60-7f58-42df-9567-fd101e701e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9deae60-7f58-42df-9567-fd101e701e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27bc3ff-a85e-4b1f-ba0c-ff39c7471195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:42 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Volume cb27db61-f254-4e45-8acd-8e23e2ffe9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf', 'volume_size': 1} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1656539252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb27db61-f254-4e45-8acd-8e23e2ffe9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111484d3f4104b319898a9a15c0bbab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:42Z,use_quota=True,user_id='66488036913c48deb76daf851caadbc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Creating volume cb27db61-f254-4e45-8acd-8e23e2ffe9bf {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:42 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:42 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17" returned: 0 in 0.457s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:42 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf 1073741824 Sep 08 19:07:42 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:42 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17 Sep 08 19:07:42 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-b3986ce5-c9be-4d27-9c12-4105e98df2c6-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Lock "cinder-b3986ce5-c9be-4d27-9c12-4105e98df2c6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-b3986ce5-c9be-4d27-9c12-4105e98df2c6" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-b3986ce5-c9be-4d27-9c12-4105e98df2c6" acquired by "delete_volume" :: waited 0.037s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:42 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a8b88cb-995e-4173-916b-47d029524d17" returned: 0 in 0.420s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3d54d5-1018-413a-a73f-7145f49a89ab]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Lock "cinder-quobyte-9a8b88cb-995e-4173-916b-47d029524d17" released by "delete_volume" :: held 0.953s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Created reservations ['6830b842-93b8-4fa3-b357-c09e9b153db8', '4c0e0499-9c80-46fd-8178-0b5fbee08f3f', '17669a39-197d-4435-a019-6523538f4b63', '16adb5e3-e2e6-4b61-a5d5-08d05e30fa8f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:42 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf 1073741824" returned: 0 in 0.621s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:42 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 Sep 08 19:07:42 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:42 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:42 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:42 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf Sep 08 19:07:42 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:43 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:43 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Deleted volume successfully. Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6" returned: 0 in 0.534s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b398bb83-ea8d-48f6-b50d-3e61f765495c tempest-VolumesActionsTest-1338526523 None] Lock "cinder-9a8b88cb-995e-4173-916b-47d029524d17-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:43 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6 Sep 08 19:07:43 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:43 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf" returned: 0 in 0.385s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27bc3ff-a85e-4b1f-ba0c-ff39c7471195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512099d6-2cca-4aa3-ab27-f501ad33a821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:43 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Volume volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf (cb27db61-f254-4e45-8acd-8e23e2ffe9bf): created successfully Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512099d6-2cca-4aa3-ab27-f501ad33a821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Flow 'volume_create_manager' (2c0da547-e949-4a38-a40a-ef2f2ba4e5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-622ff989-bf8d-4fd0-b12f-b8748cbf40f1 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Created volume successfully. Sep 08 19:07:43 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b3986ce5-c9be-4d27-9c12-4105e98df2c6" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-b3986ce5-c9be-4d27-9c12-4105e98df2c6" released by "delete_volume" :: held 0.868s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Created reservations ['4e689d4d-accd-473a-a51d-b76c5997529e', 'c90e02b4-7ad3-4385-81c2-09c50699f2d9', 'd4bf2822-d044-414a-8506-6ff7d1be381f', '532d3dcf-e7c0-4e73-88ac-1a327a5581a5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:43 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:43 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Lock "cinder-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:43 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Acquiring lock "cinder-quobyte-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Deleted volume successfully. Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5" acquired by "delete_volume" :: waited 0.049s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6d29d5f7-c13c-4716-a8de-1bc4d14ceecf tempest-VolumesGetTest-883227882 None] Lock "cinder-b3986ce5-c9be-4d27-9c12-4105e98df2c6-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6899b689-a5d0-490f-8eff-b26c197708c7]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:44 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 Sep 08 19:07:44 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:44 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5" returned: 0 in 0.579s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:44 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5 Sep 08 19:07:44 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:44 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5" returned: 0 in 0.348s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Lock "cinder-quobyte-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5" released by "delete_volume" :: held 1.021s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Created reservations ['2dc47ac8-40fe-43de-a02d-0c0e9c95a793', '5f588934-e8ae-433c-95a4-a440c91d35c6', '36dddd5c-ff99-426d-9ab8-82314ee4f38b', '687a28ea-a6dc-4408-8bf0-297bcff22cf2'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:45 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:45 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Acquiring lock "cinder-cb27db61-f254-4e45-8acd-8e23e2ffe9bf-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "cinder-cb27db61-f254-4e45-8acd-8e23e2ffe9bf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:45 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.362s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Deleted volume successfully. Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Acquiring lock "cinder-quobyte-cb27db61-f254-4e45-8acd-8e23e2ffe9bf" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-81c34557-3a0e-407a-96d5-07a8718bd032 tempest-VolumesGetTest-883227882 None] Lock "cinder-3314a3d2-54e2-4cbf-9bc7-dc4b7735cca5-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "cinder-quobyte-cb27db61-f254-4e45-8acd-8e23e2ffe9bf" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f999b6-7b2d-452b-a816-47ced8232348]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:45 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf Sep 08 19:07:45 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:45 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:46 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf Sep 08 19:07:46 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:46 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cb27db61-f254-4e45-8acd-8e23e2ffe9bf" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "cinder-quobyte-cb27db61-f254-4e45-8acd-8e23e2ffe9bf" released by "delete_volume" :: held 0.726s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Created reservations ['028a9a70-1afe-499c-b339-23fd3409e33f', 'f3aed76a-4a71-432e-abc4-8bb7374b0c53', 'f91fd158-38d0-43be-9111-4bcb3043450a', '779b8953-836a-477d-8706-b70994d82129'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:46 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:46 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:46 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Deleted volume successfully. Sep 08 19:07:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8a8fd94-8d78-49fc-8636-fcf1db8982b7 tempest-VolumeQuotasNegativeTestJSON-126699619 None] Lock "cinder-cb27db61-f254-4e45-8acd-8e23e2ffe9bf-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (3cd52c92-2bc6-4754-a606-e747c8e561e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70748c8-037c-4fbe-8a93-3aea1cceebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70748c8-037c-4fbe-8a93-3aea1cceebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-609821805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd2813f-aa06-4866-81ba-27924f7e19c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:47Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967b4d38-4e1a-49ea-9040-113c402e99bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967b4d38-4e1a-49ea-9040-113c402e99bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31eb2d5b-458b-4612-8017-ef4e2338ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31eb2d5b-458b-4612-8017-ef4e2338ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd2813f-aa06-4866-81ba-27924f7e19c2', 'volume_name': 'volume-bbd2813f-aa06-4866-81ba-27924f7e19c2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789e20be-43ac-4cc5-8df4-a1f65a2b8396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789e20be-43ac-4cc5-8df4-a1f65a2b8396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4adb0a-83f4-4afe-8b73-2197f87a09c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:47 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Volume bbd2813f-aa06-4866-81ba-27924f7e19c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd2813f-aa06-4866-81ba-27924f7e19c2', 'volume_size': 1} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-609821805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd2813f-aa06-4866-81ba-27924f7e19c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:47Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Creating volume bbd2813f-aa06-4866-81ba-27924f7e19c2 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:47 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:47 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 1073741824 Sep 08 19:07:47 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:48 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 1073741824" returned: 0 in 0.571s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:48 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 Sep 08 19:07:48 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:48 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2" returned: 0 in 0.329s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4adb0a-83f4-4afe-8b73-2197f87a09c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd2813f-aa06-4866-81ba-27924f7e19c2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973cfff9-213a-4019-bb3a-05b538368197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:48 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Volume volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 (bbd2813f-aa06-4866-81ba-27924f7e19c2): created successfully Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973cfff9-213a-4019-bb3a-05b538368197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (3cd52c92-2bc6-4754-a606-e747c8e561e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e6be10e4-0f88-4584-a668-ae509d504448 tempest-VolumesActionsTest-1338526523 None] Created volume successfully. Sep 08 19:07:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-bbd2813f-aa06-4866-81ba-27924f7e19c2-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-bbd2813f-aa06-4866-81ba-27924f7e19c2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-quobyte-bbd2813f-aa06-4866-81ba-27924f7e19c2" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-bbd2813f-aa06-4866-81ba-27924f7e19c2" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:49 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af4f4f-d5b6-486a-95e7-9c318703dc0c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:49 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 Sep 08 19:07:49 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:50 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2" returned: 0 in 0.488s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:50 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2 Sep 08 19:07:50 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:50 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bbd2813f-aa06-4866-81ba-27924f7e19c2" returned: 0 in 0.565s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-bbd2813f-aa06-4866-81ba-27924f7e19c2" released by "delete_volume" :: held 1.130s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Created reservations ['7b14a19c-d04b-48bf-bdec-4bb111ae2152', '0262afa3-1674-4ccc-a146-1d511e30f39d', 'fc4b956d-35cd-4bcc-9c29-21a946b9225e', 'f2555bc4-dfba-41f0-80ed-3171aab52989'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:51 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:51 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:51 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.370s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Deleted volume successfully. Sep 08 19:07:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-37725d72-ee43-4a63-bfc5-2ed8fcae501c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-bbd2813f-aa06-4866-81ba-27924f7e19c2-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (96ef6200-2b0c-4aba-89d7-e8128a60c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f93433-3cf6-4d13-901a-f21d9240222e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f93433-3cf6-4d13-901a-f21d9240222e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632860693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbf7ffe-06a9-42c0-998b-30302d8e08c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:53Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffc998e-d732-41f4-bb4c-c44dde51a31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffc998e-d732-41f4-bb4c-c44dde51a31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e01167-48dc-4405-8654-f2c699c7a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e01167-48dc-4405-8654-f2c699c7a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bbf7ffe-06a9-42c0-998b-30302d8e08c3', 'volume_name': 'volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72941fb8-1e2d-4463-86d5-0cf26a28909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72941fb8-1e2d-4463-86d5-0cf26a28909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a24dd6-8ed3-4b2f-9c8e-dd29a6cff464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Volume 8bbf7ffe-06a9-42c0-998b-30302d8e08c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3', 'volume_size': 1} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-632860693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbf7ffe-06a9-42c0-998b-30302d8e08c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:53Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Creating volume 8bbf7ffe-06a9-42c0-998b-30302d8e08c3 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:53 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:53 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 1073741824 Sep 08 19:07:53 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:53 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 1073741824" returned: 0 in 0.551s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:53 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 Sep 08 19:07:53 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:53 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3" returned: 0 in 0.295s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a24dd6-8ed3-4b2f-9c8e-dd29a6cff464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e92a19-d681-4473-9847-3b864e8e672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Volume volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 (8bbf7ffe-06a9-42c0-998b-30302d8e08c3): created successfully Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e92a19-d681-4473-9847-3b864e8e672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (96ef6200-2b0c-4aba-89d7-e8128a60c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-79315d4f-fcbf-4216-9363-fd3364b4560d tempest-VolumesActionsTest-1338526523 None] Created volume successfully. Sep 08 19:07:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Acquiring lock "cinder-10d39f2f-1512-48cb-a546-c74053103893-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "cinder-10d39f2f-1512-48cb-a546-c74053103893-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Acquiring lock "cinder-quobyte-10d39f2f-1512-48cb-a546-c74053103893" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "cinder-quobyte-10d39f2f-1512-48cb-a546-c74053103893" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:54 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[40874a87-b71f-4260-8049-05db7baadf93]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:54 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 Sep 08 19:07:54 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-8bbf7ffe-06a9-42c0-998b-30302d8e08c3-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-8bbf7ffe-06a9-42c0-998b-30302d8e08c3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-quobyte-8bbf7ffe-06a9-42c0-998b-30302d8e08c3" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:55 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893" returned: 0 in 0.573s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-8bbf7ffe-06a9-42c0-998b-30302d8e08c3" acquired by "delete_volume" :: waited 0.037s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:55 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893 Sep 08 19:07:55 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36be1a3-1d4a-47f4-af27-d0e122e98fca]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:55 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 Sep 08 19:07:55 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:55 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-10d39f2f-1512-48cb-a546-c74053103893" returned: 0 in 0.294s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "cinder-quobyte-10d39f2f-1512-48cb-a546-c74053103893" released by "delete_volume" :: held 0.934s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Created reservations ['d3253220-53a4-4502-bfde-bb75bd555e0e', 'f6fb730e-872e-4857-bc2d-57f000e53ec2', '67066b8e-5a05-4b18-9bc9-e7d8d7cdbc83', 'b0f3f3fc-194b-44eb-96cb-2cd26b6a1297'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:55 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3" returned: 0 in 0.465s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:55 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:55 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:55 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3 Sep 08 19:07:55 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:56 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Deleted volume successfully. Sep 08 19:07:56 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8bbf7ffe-06a9-42c0-998b-30302d8e08c3" returned: 0 in 0.295s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1fa11394-9247-4ded-ab86-c346161556d0 tempest-AttachVolumeShelveTestJSON-289772527 None] Lock "cinder-10d39f2f-1512-48cb-a546-c74053103893-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-8bbf7ffe-06a9-42c0-998b-30302d8e08c3" released by "delete_volume" :: held 0.828s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Created reservations ['d2c2c77a-06ca-4e47-9415-9ac024ad21e8', '1eb4ae41-f24b-4191-8725-f11163512409', '378a03ab-2d9e-4c27-a225-5f24a8f13a54', '42975ab5-88e2-4cd8-8ffc-8c6431db67f6'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:56 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:07:56 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:56 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:07:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Deleted volume successfully. Sep 08 19:07:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3c3bda54-d29f-4fd0-9a7e-7df90eec4cf7 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-8bbf7ffe-06a9-42c0-998b-30302d8e08c3-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (84fca224-7015-4991-ba2a-3681e7ceac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9580d77-f8bc-4010-b369-4299cea21cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9580d77-f8bc-4010-b369-4299cea21cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1119852451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd11f0fa-0196-4611-9483-1da18f7a7d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:57Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad00561b-72d6-43ca-ade5-fa699865066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad00561b-72d6-43ca-ade5-fa699865066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a2a6c-5db6-4560-ac30-f8f46d6b8299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a2a6c-5db6-4560-ac30-f8f46d6b8299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd11f0fa-0196-4611-9483-1da18f7a7d79', 'volume_name': 'volume-fd11f0fa-0196-4611-9483-1da18f7a7d79', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d62382-6b5a-4174-9bbd-95ede58ec685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d62382-6b5a-4174-9bbd-95ede58ec685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8eeded-18cc-4458-be2c-cdfcc1c89c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:57 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Volume fd11f0fa-0196-4611-9483-1da18f7a7d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd11f0fa-0196-4611-9483-1da18f7a7d79', 'volume_size': 1} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1119852451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd11f0fa-0196-4611-9483-1da18f7a7d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:07:57Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Creating volume fd11f0fa-0196-4611-9483-1da18f7a7d79 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:07:57 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:57 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 1073741824 Sep 08 19:07:57 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:57 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 1073741824" returned: 0 in 0.525s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:57 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 Sep 08 19:07:57 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:58 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79" returned: 0 in 0.325s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:07:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:07:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8eeded-18cc-4458-be2c-cdfcc1c89c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd11f0fa-0196-4611-9483-1da18f7a7d79', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986b9d58-5db7-49c9-83b2-2e2351a7d702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:07:58 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Volume volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 (fd11f0fa-0196-4611-9483-1da18f7a7d79): created successfully Sep 08 19:07:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986b9d58-5db7-49c9-83b2-2e2351a7d702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:07:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (84fca224-7015-4991-ba2a-3681e7ceac81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:07:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3a012f4c-ce1a-4776-9206-226c42ceb62a tempest-VolumesActionsTest-1338526523 None] Created volume successfully. Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-fd11f0fa-0196-4611-9483-1da18f7a7d79-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-fd11f0fa-0196-4611-9483-1da18f7a7d79-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-quobyte-fd11f0fa-0196-4611-9483-1da18f7a7d79" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-fd11f0fa-0196-4611-9483-1da18f7a7d79" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c2fb05-4d62-459c-9d4d-31b57f0ecc9e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:07:59 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 Sep 08 19:07:59 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:07:59 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79" returned: 0 in 0.480s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:07:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:00 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79 Sep 08 19:08:00 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:00 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd11f0fa-0196-4611-9483-1da18f7a7d79" returned: 0 in 0.387s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-fd11f0fa-0196-4611-9483-1da18f7a7d79" released by "delete_volume" :: held 0.929s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Created reservations ['22258ffb-f321-465a-9d6f-df11905cddbf', '86ef1682-6543-4e62-8a9a-2f3224852ba9', '52df3883-6044-4646-93bc-62d8951eb3ca', '56a961b0-242c-450a-b59d-f19af7b73a3a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:00 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:00 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:00 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Deleted volume successfully. Sep 08 19:08:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-256228e7-4ded-4b2e-9250-fe6a95743766 tempest-VolumesActionsTest-1118478353 None] Lock "cinder-fd11f0fa-0196-4611-9483-1da18f7a7d79-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (b2eaef4c-935b-451f-ac85-6c3a38072b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33559f4-a8f7-4c2a-974a-e41c8bee12ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33559f4-a8f7-4c2a-974a-e41c8bee12ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-547765783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f88ded-c715-4376-ac63-f0946d139483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:03Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf0702b-1b65-42ed-97a6-11d729a3a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf0702b-1b65-42ed-97a6-11d729a3a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1eb48d-2d03-4d4b-b7ea-6d3128cc6373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1eb48d-2d03-4d4b-b7ea-6d3128cc6373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f88ded-c715-4376-ac63-f0946d139483', 'volume_name': 'volume-a7f88ded-c715-4376-ac63-f0946d139483', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae60b071-0636-4eee-bb26-9fc98ab78621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae60b071-0636-4eee-bb26-9fc98ab78621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d2961d-0e79-4f27-8906-e8ec363f8eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Volume a7f88ded-c715-4376-ac63-f0946d139483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f88ded-c715-4376-ac63-f0946d139483', 'volume_size': 1} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-547765783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f88ded-c715-4376-ac63-f0946d139483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:03Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Creating volume a7f88ded-c715-4376-ac63-f0946d139483 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:02 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:02 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 1073741824 Sep 08 19:08:02 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:03 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 1073741824" returned: 0 in 0.607s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:03 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 Sep 08 19:08:03 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:03 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483" returned: 0 in 0.454s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7d2961d-0e79-4f27-8906-e8ec363f8eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f88ded-c715-4376-ac63-f0946d139483', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6916feba-1aed-46e0-ab91-1c637b988517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Volume volume-a7f88ded-c715-4376-ac63-f0946d139483 (a7f88ded-c715-4376-ac63-f0946d139483): created successfully Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6916feba-1aed-46e0-ab91-1c637b988517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (b2eaef4c-935b-451f-ac85-6c3a38072b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-aed89eae-febf-4573-89f3-7ed13974a6fb tempest-VolumesActionsTest-1338526523 None] Created volume successfully. Sep 08 19:08:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-a7f88ded-c715-4376-ac63-f0946d139483-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-a7f88ded-c715-4376-ac63-f0946d139483-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Acquiring lock "cinder-quobyte-a7f88ded-c715-4376-ac63-f0946d139483" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-a7f88ded-c715-4376-ac63-f0946d139483" acquired by "delete_volume" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:05 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[28be9f97-5906-4449-b0be-daa4aee4f11f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:05 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 Sep 08 19:08:05 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:05 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483" returned: 0 in 0.582s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:05 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483 Sep 08 19:08:05 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:06 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a7f88ded-c715-4376-ac63-f0946d139483" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-quobyte-a7f88ded-c715-4376-ac63-f0946d139483" released by "delete_volume" :: held 1.030s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Created reservations ['c6d4eea7-d724-43dd-9496-c4e2ec40acdb', '9dcf3c5b-cb48-479d-9b76-55cdfc0a9c2e', '4b01a38c-daaa-4a3d-8b79-5d71c36cbbb0', '681569ee-3d0a-4fe4-b0e9-ad59ba51fd98'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:06 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:06 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:06 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.409s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:06 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Deleted volume successfully. Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-70ade91b-5b51-470d-bbc4-b5774af1529c tempest-VolumesActionsTest-1118478353 None] Lock "cinder-a7f88ded-c715-4376-ac63-f0946d139483-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (78ce55a2-8ee6-4c87-ae20-9530c5d013b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226acee1-142b-4520-a344-0a31c376e8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226acee1-142b-4520-a344-0a31c376e8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1620750625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad9589e-9777-4af8-baff-624151246c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:07Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c64ed1-928d-48e8-9a4f-2df81401a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c64ed1-928d-48e8-9a4f-2df81401a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0a8926-7336-499a-b052-055fa22d90bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0a8926-7336-499a-b052-055fa22d90bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad9589e-9777-4af8-baff-624151246c33', 'volume_name': 'volume-4ad9589e-9777-4af8-baff-624151246c33', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab5190b-f9cb-4c10-afd9-e68d6d39252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab5190b-f9cb-4c10-afd9-e68d6d39252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a09f57-3ec6-485a-8a92-6aba9bd1bd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:07 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Volume 4ad9589e-9777-4af8-baff-624151246c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad9589e-9777-4af8-baff-624151246c33', 'volume_size': 1} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1620750625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad9589e-9777-4af8-baff-624151246c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:07Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Creating volume 4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:07 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:07 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 1073741824 Sep 08 19:08:07 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:07 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 1073741824" returned: 0 in 0.573s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:07 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 Sep 08 19:08:07 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:08 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33" returned: 0 in 0.332s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a09f57-3ec6-485a-8a92-6aba9bd1bd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad9589e-9777-4af8-baff-624151246c33', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e493891-ab35-44a8-91fe-54bcee2f1567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Volume volume-4ad9589e-9777-4af8-baff-624151246c33 (4ad9589e-9777-4af8-baff-624151246c33): created successfully Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e493891-ab35-44a8-91fe-54bcee2f1567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (78ce55a2-8ee6-4c87-ae20-9530c5d013b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:08 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-350db984-4ea6-4f8d-9c15-85de058d50e8 tempest-VolumesSnapshotTestJSON-830010200 None] Created volume successfully. Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (e143137c-f49d-4e02-8580-b042ef3820c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951d31b0-bd93-4682-987a-4ce21eafcc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951d31b0-bd93-4682-987a-4ce21eafcc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982151620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497bd857-5860-4c01-ae31-82729879fc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:08Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81edb999-0cd6-4ffd-ab4c-c95c1fcf494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81edb999-0cd6-4ffd-ab4c-c95c1fcf494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ce5155-c9ef-4698-84ab-29d47be730c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ce5155-c9ef-4698-84ab-29d47be730c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497bd857-5860-4c01-ae31-82729879fc03', 'volume_name': 'volume-497bd857-5860-4c01-ae31-82729879fc03', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb9ebf-c992-4db1-8ff6-d6011d19eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb9ebf-c992-4db1-8ff6-d6011d19eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71133a28-6b7d-4ed8-9306-8d591bf644b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Volume 497bd857-5860-4c01-ae31-82729879fc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497bd857-5860-4c01-ae31-82729879fc03', 'volume_size': 1} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-982151620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497bd857-5860-4c01-ae31-82729879fc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11504cd9cf145f2924ce15fea9aa8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:08Z,use_quota=True,user_id='c12109e042334969ba97bcb83c186920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Creating volume 497bd857-5860-4c01-ae31-82729879fc03 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:08 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:08 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 1073741824 Sep 08 19:08:08 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:08 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 1073741824" returned: 0 in 0.536s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:08 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 Sep 08 19:08:08 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:09 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03" returned: 0 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71133a28-6b7d-4ed8-9306-8d591bf644b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497bd857-5860-4c01-ae31-82729879fc03', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b7d291-0f84-4e4c-96ab-ff184827d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:09 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Volume volume-497bd857-5860-4c01-ae31-82729879fc03 (497bd857-5860-4c01-ae31-82729879fc03): created successfully Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b7d291-0f84-4e4c-96ab-ff184827d406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Flow 'volume_create_manager' (e143137c-f49d-4e02-8580-b042ef3820c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:09 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-44798dbf-c0c4-479d-a7b9-38a33afc2a45 tempest-VolumesActionsTest-1338526523 None] Created volume successfully. Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Creating offline snapshot f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d of volume 4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20124dc-79f1-4ea5-ab04-5d2e92b44595]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:09 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 Sep 08 19:08:09 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:10 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33" returned: 0 in 0.434s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:10 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d 1G Sep 08 19:08:10 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:10 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d 1G" returned: 0 in 0.658s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad9589e-9777-4af8-baff-624151246c33 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Acquiring lock "cinder-497bd857-5860-4c01-ae31-82729879fc03-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:10 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad9589e-9777-4af8-baff-624151246c33 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d Sep 08 19:08:10 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Lock "cinder-497bd857-5860-4c01-ae31-82729879fc03-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Acquiring lock "cinder-quobyte-497bd857-5860-4c01-ae31-82729879fc03" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Lock "cinder-quobyte-497bd857-5860-4c01-ae31-82729879fc03" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceae884-1bcf-4a74-9ca9-8a65427cf355]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:11 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 Sep 08 19:08:11 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:11 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad9589e-9777-4af8-baff-624151246c33 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" returned: 0 in 0.409s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:11 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d is being set with open permissions: ugo+rw Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:11 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d Sep 08 19:08:11 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:11 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03" returned: 0 in 0.451s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:11 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03 Sep 08 19:08:11 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:11 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:11 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.info Sep 08 19:08:11 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:11 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-497bd857-5860-4c01-ae31-82729879fc03" returned: 0 in 0.317s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Lock "cinder-quobyte-497bd857-5860-4c01-ae31-82729879fc03" released by "delete_volume" :: held 0.844s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:11 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.info" returned: 0 in 0.289s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:11 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.info is being set with open permissions: ugo+rw Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:11 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Created reservations ['599d7099-3e32-4476-90fb-c4813f292955', '21aaa476-77da-454d-9eb2-e76d05e6bdb8', '7fb930c2-e408-49d4-8614-5b1371012681', '64fb3c4c-7766-4b35-8549-3cb56bdccd9e'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:12 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.info Sep 08 19:08:12 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:12 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:12 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:12 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.info" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-debf63ca-aa9f-4f1c-beb7-5588e4c1e8e2 tempest-VolumesSnapshotTestJSON-830010200 None] Create snapshot completed successfully Sep 08 19:08:12 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.460s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Deleted volume successfully. Sep 08 19:08:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0e530442-fc4d-4e77-a737-d8c7d5fe581f tempest-VolumesActionsTest-1338526523 None] Lock "cinder-497bd857-5860-4c01-ae31-82729879fc03-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-4ad9589e-9777-4af8-baff-624151246c33" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-4ad9589e-9777-4af8-baff-624151246c33" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Deleting offline snapshot f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d of volume 4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] snapshot_file for this snap is: volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443e5a5-266a-42d9-9bc7-baebbdf32a7f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:13 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d Sep 08 19:08:13 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:13 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" returned: 0 in 0.625s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ad9589e-9777-4af8-baff-624151246c33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:08:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fcd7c0-d945-42ec-aa70-fdf6d8db99cb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:14 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 Sep 08 19:08:14 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:14 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33" returned: 0 in 0.489s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:14 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d Sep 08 19:08:14 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:15 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" returned: 0 in 0.515s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:15 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d Sep 08 19:08:15 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:15 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33.f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" returned: 0 in 0.389s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d" released by "_delete_snapshot" :: held 2.173s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-4ad9589e-9777-4af8-baff-624151246c33" released by "delete_snapshot" :: held 2.222s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:15 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['889a03df-a037-493b-bece-c63163d50ca1', '69c61fa8-2dd0-46d3-a5bc-30db4a1ca617', 'a0ab325d-853f-470a-8a28-f2da7727d5c0', '06dc5092-02a7-4bb9-a607-614c07c94548'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Delete snapshot completed successfully. Sep 08 19:08:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9241efe1-0a62-4b57-8962-9ed69946eb1d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-f8b0bdb7-c32a-4b1b-8f2d-8aaeb1d6f29d-delete_snapshot" released by "delete_snapshot" :: held 2.463s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (d706b8e4-b866-4491-8a89-a6cd09f63f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cb6167-6517-483e-8fb8-d56d35412987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cb6167-6517-483e-8fb8-d56d35412987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-337586914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8452b276-8e0e-4ddd-acac-50a5c51a5b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:17Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf851b9a-d739-4578-b85c-93920500a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf851b9a-d739-4578-b85c-93920500a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d53e9a-1ed2-4b9e-9fe4-84d97e9173f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d53e9a-1ed2-4b9e-9fe4-84d97e9173f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8452b276-8e0e-4ddd-acac-50a5c51a5b28', 'volume_name': 'volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f427a469-919d-4b3d-95cc-225662519924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f427a469-919d-4b3d-95cc-225662519924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d47bc95-bedf-4b67-955d-f38fdc45a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:17 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Volume 8452b276-8e0e-4ddd-acac-50a5c51a5b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28', 'volume_size': 1} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-337586914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8452b276-8e0e-4ddd-acac-50a5c51a5b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:17Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Creating volume 8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:17 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:17 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 1073741824 Sep 08 19:08:17 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:17 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 1073741824" returned: 0 in 0.557s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:17 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 Sep 08 19:08:17 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:18 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28" returned: 0 in 0.365s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d47bc95-bedf-4b67-955d-f38fdc45a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cec25da-ed9b-4be2-9c47-8155549e4a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:18 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Volume volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 (8452b276-8e0e-4ddd-acac-50a5c51a5b28): created successfully Sep 08 19:08:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cec25da-ed9b-4be2-9c47-8155549e4a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (d706b8e4-b866-4491-8a89-a6cd09f63f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:18 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-06c69a88-d247-4541-9002-e36aa9084894 tempest-VolumesSnapshotTestJSON-830010200 None] Created volume successfully. Sep 08 19:08:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Creating offline snapshot fd95f462-f23f-4016-9ff7-d0eecd26014b of volume 8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:08:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e973db59-b9fc-4125-90a4-b8e7239176ba]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:19 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 Sep 08 19:08:19 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:19 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28" returned: 0 in 0.509s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:20 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b 1G Sep 08 19:08:20 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:20 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b 1G" returned: 0 in 0.756s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:20 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b Sep 08 19:08:20 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:21 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b" returned: 0 in 0.451s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:21 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b is being set with open permissions: ugo+rw Sep 08 19:08:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:21 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b Sep 08 19:08:21 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:21 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b" returned: 0 in 0.312s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:21 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.info Sep 08 19:08:21 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:21 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.info" returned: 0 in 0.346s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:21 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.info is being set with open permissions: ugo+rw Sep 08 19:08:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:21 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.info Sep 08 19:08:21 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:22 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.info" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c6f9fd9f-fd79-49c9-aded-3f91974c07a3 tempest-VolumesSnapshotTestJSON-830010200 None] Create snapshot completed successfully Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (c64c7b03-f01f-479a-92f4-8903fde7c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71582a0d-db58-437b-9a5f-9d7a6f70bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71582a0d-db58-437b-9a5f-9d7a6f70bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1980322403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb645f9d-a584-4667-8145-f9142eab1613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fd95f462-f23f-4016-9ff7-d0eecd26014b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:23Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e122a0-b248-44c3-bb0e-40007de632d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3e122a0-b248-44c3-bb0e-40007de632d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad317c5-ddf3-4694-86a5-3256a2087dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad317c5-ddf3-4694-86a5-3256a2087dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb645f9d-a584-4667-8145-f9142eab1613', 'volume_name': 'volume-fb645f9d-a584-4667-8145-f9142eab1613', 'volume_size': 2, 'snapshot_id': 'fd95f462-f23f-4016-9ff7-d0eecd26014b'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165cb528-9ab2-4348-a28b-ea7b7572706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165cb528-9ab2-4348-a28b-ea7b7572706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c31177-7479-4951-b112-2be4b6f25a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:23 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Volume fb645f9d-a584-4667-8145-f9142eab1613: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb645f9d-a584-4667-8145-f9142eab1613', 'volume_size': 2, 'snapshot_id': 'fd95f462-f23f-4016-9ff7-d0eecd26014b'} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-fd95f462-f23f-4016-9ff7-d0eecd26014b-fb645f9d-a584-4667-8145-f9142eab1613" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fd95f462-f23f-4016-9ff7-d0eecd26014b-fb645f9d-a584-4667-8145-f9142eab1613" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Creating volume fb645f9d-a584-4667-8145-f9142eab1613 from snapshot fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-fb645f9d-a584-4667-8145-f9142eab1613" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fb645f9d-a584-4667-8145-f9142eab1613" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] snapshot: fd95f462-f23f-4016-9ff7-d0eecd26014b, volume: fb645f9d-a584-4667-8145-f9142eab1613, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bcb353-25a9-4e95-9b75-54bfa12ed20e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:23 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b Sep 08 19:08:23 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:24 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b" returned: 0 in 0.553s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cf0964-085f-47a1-9f94-93dcc9292546]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:24 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 Sep 08 19:08:24 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:24 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28" returned: 0 in 0.420s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:08:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:24 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 Sep 08 19:08:24 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:31 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613" returned: 0 in 6.893s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:08:31 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Converted 1024.00 MB image at 148.50 MB/s Sep 08 19:08:31 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 is being set with open permissions: ugo+rw Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:31 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 Sep 08 19:08:31 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:31 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613" returned: 0 in 0.371s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fb645f9d-a584-4667-8145-f9142eab1613" released by "_copy_volume_from_snapshot" :: held 8.361s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=107,cinder:UPDATE=134,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=108,cinder:INSERT=38,cinder:UPDATE=121,cinder:DELETE=15 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fd95f462-f23f-4016-9ff7-d0eecd26014b-fb645f9d-a584-4667-8145-f9142eab1613" released by "_create_volume_from_snapshot" :: held 8.468s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.485s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c31177-7479-4951-b112-2be4b6f25a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb645f9d-a584-4667-8145-f9142eab1613', 'volume_size': 2, 'snapshot_id': 'fd95f462-f23f-4016-9ff7-d0eecd26014b'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cf6af5-82fc-48ce-b777-679f23be078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Volume volume-fb645f9d-a584-4667-8145-f9142eab1613 (fb645f9d-a584-4667-8145-f9142eab1613): created successfully Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07cf6af5-82fc-48ce-b777-679f23be078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (c64c7b03-f01f-479a-92f4-8903fde7c752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-21fd9136-ab27-4b80-a957-ddf701606fd4 tempest-VolumesSnapshotTestJSON-830010200 None] Created volume successfully. Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Flow 'volume_create_manager' (ad3b8df4-dcbb-4f73-aa1b-77853f52a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e11478-08f5-41fd-ab8b-edd68b507477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e11478-08f5-41fd-ab8b-edd68b507477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-474892841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4792db27-2ddc-42d1-9139-8fbcdd59c658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5eb29dbb1d4f33969c6bc6106a4371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:32Z,use_quota=True,user_id='4acaecf86a9940cf92727906f89f4bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ac450e-2379-40ec-96fd-7252f93513b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ac450e-2379-40ec-96fd-7252f93513b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd665351-c562-491d-a95e-051fbd523765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd665351-c562-491d-a95e-051fbd523765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4792db27-2ddc-42d1-9139-8fbcdd59c658', 'volume_name': 'volume-4792db27-2ddc-42d1-9139-8fbcdd59c658', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97fa5f0-046c-4af8-8403-c320580f1191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97fa5f0-046c-4af8-8403-c320580f1191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3219a1-a790-4abe-b164-00de10ffe49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:32 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Volume 4792db27-2ddc-42d1-9139-8fbcdd59c658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4792db27-2ddc-42d1-9139-8fbcdd59c658', 'volume_size': 1} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-474892841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4792db27-2ddc-42d1-9139-8fbcdd59c658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5eb29dbb1d4f33969c6bc6106a4371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:32Z,use_quota=True,user_id='4acaecf86a9940cf92727906f89f4bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Creating volume 4792db27-2ddc-42d1-9139-8fbcdd59c658 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:32 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:32 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 1073741824 Sep 08 19:08:32 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-fb645f9d-a584-4667-8145-f9142eab1613-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-fb645f9d-a584-4667-8145-f9142eab1613-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-fb645f9d-a584-4667-8145-f9142eab1613" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fb645f9d-a584-4667-8145-f9142eab1613" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f9c680-c25b-43ef-ab32-59a6db5382e5]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:32 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 Sep 08 19:08:32 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:33 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 1073741824" returned: 0 in 0.868s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:33 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 Sep 08 19:08:33 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:33 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613" returned: 0 in 0.841s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:33 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613 Sep 08 19:08:33 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:33 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb645f9d-a584-4667-8145-f9142eab1613" returned: 0 in 0.390s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fb645f9d-a584-4667-8145-f9142eab1613" released by "delete_volume" :: held 1.306s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:33 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658" returned: 0 in 0.593s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3219a1-a790-4abe-b164-00de10ffe49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4792db27-2ddc-42d1-9139-8fbcdd59c658', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d29995-4a5a-45ab-9fe8-66dbfb0a121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Volume volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 (4792db27-2ddc-42d1-9139-8fbcdd59c658): created successfully Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d29995-4a5a-45ab-9fe8-66dbfb0a121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Flow 'volume_create_manager' (ad3b8df4-dcbb-4f73-aa1b-77853f52a45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-56aed138-5a11-4595-b80f-bf2b0cf6928b tempest-AbsoluteLimitsTests-1153028222 None] Created volume successfully. Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['c55ae782-eddf-4e36-95e5-26333584dce6', '0ca56824-7dae-4fa5-8928-606290951952', '424a0724-3aff-4aa3-a2b9-ba9ccdf15df8', '6538a510-1bf1-41f4-ae1e-8b72d36996b6'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:34 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:34 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:34 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:34 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:34 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.392s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 28 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:08:34 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.484s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Deleted volume successfully. Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d618a53c-016e-4efe-ae4d-43ccd5240c5f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-fb645f9d-a584-4667-8145-f9142eab1613-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-fd95f462-f23f-4016-9ff7-d0eecd26014b-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-fd95f462-f23f-4016-9ff7-d0eecd26014b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-8452b276-8e0e-4ddd-acac-50a5c51a5b28" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-8452b276-8e0e-4ddd-acac-50a5c51a5b28" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-fd95f462-f23f-4016-9ff7-d0eecd26014b" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fd95f462-f23f-4016-9ff7-d0eecd26014b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Deleting offline snapshot fd95f462-f23f-4016-9ff7-d0eecd26014b of volume 8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] snapshot_file for this snap is: volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Acquiring lock "cinder-4792db27-2ddc-42d1-9139-8fbcdd59c658-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf649d5-23d0-420e-8a39-543e89121338]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Lock "cinder-4792db27-2ddc-42d1-9139-8fbcdd59c658-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Acquiring lock "cinder-quobyte-4792db27-2ddc-42d1-9139-8fbcdd59c658" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Lock "cinder-quobyte-4792db27-2ddc-42d1-9139-8fbcdd59c658" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7f07d-6269-42ff-ab76-b7def9351231]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:35 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b Sep 08 19:08:35 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:35 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 Sep 08 19:08:35 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:36 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b" returned: 0 in 0.655s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2ff83a-858c-4e27-a2ae-5275b80bf251]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:36 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658" returned: 0 in 0.548s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:36 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658 Sep 08 19:08:36 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:36 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 Sep 08 19:08:36 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:36 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4792db27-2ddc-42d1-9139-8fbcdd59c658" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Lock "cinder-quobyte-4792db27-2ddc-42d1-9139-8fbcdd59c658" released by "delete_volume" :: held 1.014s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Created reservations ['05af1d20-f525-4b66-b738-e6fd63533d25', 'ee21784b-1884-4e80-aba3-e692ee7b6469', '1b6a1584-98f8-44df-b7c2-7a7c8bb5a4c3', '1dfd0ad5-ba17-4b79-bb39-b4ab29bf45e2'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:36 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28" returned: 0 in 0.746s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:36 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:36 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:36 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b Sep 08 19:08:36 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:37 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.549s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Deleted volume successfully. Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-df338e03-8b58-4b49-ad17-34c5905610cb tempest-AbsoluteLimitsTests-1153028222 None] Lock "cinder-4792db27-2ddc-42d1-9139-8fbcdd59c658-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:37 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b" returned: 0 in 0.652s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:37 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b Sep 08 19:08:37 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:37 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28.fd95f462-f23f-4016-9ff7-d0eecd26014b" returned: 0 in 0.395s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-fd95f462-f23f-4016-9ff7-d0eecd26014b" released by "_delete_snapshot" :: held 2.656s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-8452b276-8e0e-4ddd-acac-50a5c51a5b28" released by "delete_snapshot" :: held 2.709s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['f550473f-dc46-4f1f-80f1-8574f219e3d8', 'cbafb52a-870a-45c4-b256-caa6d3d961ec', '20f161b3-a51e-4793-b18d-fc7c5c25d8e8', '11368819-1cdf-4727-b23f-ad550103b274'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Delete snapshot completed successfully. Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f9f4783-924f-412f-aad6-334679cd185f tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-fd95f462-f23f-4016-9ff7-d0eecd26014b-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-8452b276-8e0e-4ddd-acac-50a5c51a5b28-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-8452b276-8e0e-4ddd-acac-50a5c51a5b28-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-8452b276-8e0e-4ddd-acac-50a5c51a5b28" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-8452b276-8e0e-4ddd-acac-50a5c51a5b28" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee69bf3-c7ae-4240-b841-ddc5f323e792]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:38 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Flow 'volume_create_manager' (0e28b303-dc9e-49be-923e-0db567cb011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc86721-a8d1-4d61-8042-91bbc5204952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:39 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 Sep 08 19:08:39 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc86721-a8d1-4d61-8042-91bbc5204952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1755264101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae31d31-8568-4900-b2db-6c62b6c4e94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c732a54f772943a19e136b7269578133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:39Z,use_quota=True,user_id='89c6f534f7cc4f87ad196d68ba314295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72df9801-e13b-439f-9ba4-e08c050dcb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72df9801-e13b-439f-9ba4-e08c050dcb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dd0b03-50fb-4ec0-b8fc-ba2cae3f54af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dd0b03-50fb-4ec0-b8fc-ba2cae3f54af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae31d31-8568-4900-b2db-6c62b6c4e94a', 'volume_name': 'volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8ca137-f803-428b-84eb-5ae78377d4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8ca137-f803-428b-84eb-5ae78377d4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a016de-3d61-489b-97f0-b1ac60f54caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:39 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Volume 9ae31d31-8568-4900-b2db-6c62b6c4e94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a', 'volume_size': 1} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1755264101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae31d31-8568-4900-b2db-6c62b6c4e94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c732a54f772943a19e136b7269578133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:39Z,use_quota=True,user_id='89c6f534f7cc4f87ad196d68ba314295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Creating volume 9ae31d31-8568-4900-b2db-6c62b6c4e94a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:39 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:39 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a 1073741824 Sep 08 19:08:39 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:39 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28" returned: 0 in 0.525s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:39 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28 Sep 08 19:08:39 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:39 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8452b276-8e0e-4ddd-acac-50a5c51a5b28" returned: 0 in 0.306s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-8452b276-8e0e-4ddd-acac-50a5c51a5b28" released by "delete_volume" :: held 0.985s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:39 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a 1073741824" returned: 0 in 0.583s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:39 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a Sep 08 19:08:39 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:39 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['ce8b1f1b-965b-42b2-9432-ef4dbf7921bd', 'b7e60cdb-0eac-450d-99f2-df29ebf3e278', '2b4fde99-a2b8-4413-a650-5cc376de60ed', '04332d53-3530-416c-922f-87953fe2d7e9'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:40 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:40 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:40 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a" returned: 0 in 0.391s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a016de-3d61-489b-97f0-b1ac60f54caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583cd8bb-3c88-41ec-bdda-1a5f68f02a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Volume volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a (9ae31d31-8568-4900-b2db-6c62b6c4e94a): created successfully Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583cd8bb-3c88-41ec-bdda-1a5f68f02a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Flow 'volume_create_manager' (0e28b303-dc9e-49be-923e-0db567cb011b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f656ed1e-7e70-4d73-982a-c6d260a92956 tempest-VolumesListAdminTestJSON-1862555200 None] Created volume successfully. Sep 08 19:08:40 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Deleted volume successfully. Sep 08 19:08:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8e8944b-58f8-46db-ba27-f852143a0785 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-8452b276-8e0e-4ddd-acac-50a5c51a5b28-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (38e148c8-c453-4cf1-83c0-841bfb320e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2139c68f-c884-4976-8dd2-7d689b79fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2139c68f-c884-4976-8dd2-7d689b79fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1539457401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529525dc-986a-42ae-8a1c-d86da90cfa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:42Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326b4122-b81d-4788-ba66-b4a41ff9f625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326b4122-b81d-4788-ba66-b4a41ff9f625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814b2d18-d113-4c46-a11e-eb69b98e8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814b2d18-d113-4c46-a11e-eb69b98e8304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529525dc-986a-42ae-8a1c-d86da90cfa3b', 'volume_name': 'volume-529525dc-986a-42ae-8a1c-d86da90cfa3b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5591b240-873a-425c-91f6-f8a618a6a320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5591b240-873a-425c-91f6-f8a618a6a320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fb3aa5-50a4-4f6c-b9d2-cff104f9da3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Volume 529525dc-986a-42ae-8a1c-d86da90cfa3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529525dc-986a-42ae-8a1c-d86da90cfa3b', 'volume_size': 1} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1539457401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529525dc-986a-42ae-8a1c-d86da90cfa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:42Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Creating volume 529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:42 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:42 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b 1073741824 Sep 08 19:08:42 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Flow 'volume_create_manager' (cbfa5c7e-d13f-40bd-ac6b-647b6f5c8fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0d9e3d-84ef-4e76-9a93-9ff967e60486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0d9e3d-84ef-4e76-9a93-9ff967e60486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-105189820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e999f-496c-45f7-9b2f-faa279fc8cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c732a54f772943a19e136b7269578133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:42Z,use_quota=True,user_id='89c6f534f7cc4f87ad196d68ba314295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c3105a-4a1d-412e-9ec0-5964987fefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8c3105a-4a1d-412e-9ec0-5964987fefda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0170bb37-20dd-4d08-92f3-811378751427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0170bb37-20dd-4d08-92f3-811378751427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9e999f-496c-45f7-9b2f-faa279fc8cd2', 'volume_name': 'volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6039b0be-47a2-46c6-bce3-8d8c7a624c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6039b0be-47a2-46c6-bce3-8d8c7a624c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d0eb22-c974-461d-aa1c-598b9b08b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:42 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Volume 9a9e999f-496c-45f7-9b2f-faa279fc8cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2', 'volume_size': 1} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:42 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b 1073741824" returned: 0 in 0.489s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:42 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b Sep 08 19:08:42 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:42 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b" returned: 0 in 0.288s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-105189820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9e999f-496c-45f7-9b2f-faa279fc8cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c732a54f772943a19e136b7269578133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:42Z,use_quota=True,user_id='89c6f534f7cc4f87ad196d68ba314295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Creating volume 9a9e999f-496c-45f7-9b2f-faa279fc8cd2 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:42 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fb3aa5-50a4-4f6c-b9d2-cff104f9da3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529525dc-986a-42ae-8a1c-d86da90cfa3b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6083db2d-05a3-47b9-8382-f0df2c77d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:43 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 1073741824 Sep 08 19:08:43 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:43 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Volume volume-529525dc-986a-42ae-8a1c-d86da90cfa3b (529525dc-986a-42ae-8a1c-d86da90cfa3b): created successfully Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6083db2d-05a3-47b9-8382-f0df2c77d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (38e148c8-c453-4cf1-83c0-841bfb320e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6c3a9a65-c3b0-4881-93ee-288669891e64 tempest-VolumesSnapshotTestJSON-830010200 None] Created volume successfully. Sep 08 19:08:43 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 1073741824" returned: 0 in 0.539s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:43 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 Sep 08 19:08:43 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:43 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2" returned: 0 in 0.364s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d0eb22-c974-461d-aa1c-598b9b08b73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0311320d-3573-46d9-bf48-b27dcce4c004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:43 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Volume volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 (9a9e999f-496c-45f7-9b2f-faa279fc8cd2): created successfully Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0311320d-3573-46d9-bf48-b27dcce4c004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Flow 'volume_create_manager' (cbfa5c7e-d13f-40bd-ac6b-647b6f5c8fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d04fbcd1-6162-4507-acd4-45c8b11f58f8 tempest-VolumesListAdminTestJSON-1862555200 None] Created volume successfully. Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Creating offline snapshot 19a49d6a-2841-4c5b-bfa4-cb54221cfe6c of volume 529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be30d0-8477-4f03-a761-c3fb348912a7]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:44 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b Sep 08 19:08:44 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:44 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b" returned: 0 in 0.415s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:44 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c 1G Sep 08 19:08:44 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:45 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c 1G" returned: 0 in 0.527s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529525dc-986a-42ae-8a1c-d86da90cfa3b -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:45 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529525dc-986a-42ae-8a1c-d86da90cfa3b -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c Sep 08 19:08:45 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:45 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529525dc-986a-42ae-8a1c-d86da90cfa3b -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" returned: 0 in 0.456s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:45 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c is being set with open permissions: ugo+rw Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:45 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c Sep 08 19:08:45 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Flow 'volume_create_manager' (2aeecea2-30de-4459-aa61-7cf0503b8bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37713e68-c514-453f-89c2-cbf36205192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37713e68-c514-453f-89c2-cbf36205192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952259207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d88a88-ca50-4ba8-a92c-150b786d908e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c732a54f772943a19e136b7269578133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:46Z,use_quota=True,user_id='89c6f534f7cc4f87ad196d68ba314295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae47932-3a16-43f7-a2e0-3c30989f8809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae47932-3a16-43f7-a2e0-3c30989f8809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8955b338-bdfe-4c15-9b6b-e61fc59e7e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8955b338-bdfe-4c15-9b6b-e61fc59e7e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d88a88-ca50-4ba8-a92c-150b786d908e', 'volume_name': 'volume-d4d88a88-ca50-4ba8-a92c-150b786d908e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54ea1bb-20a0-4a1f-a961-2aac70ca614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54ea1bb-20a0-4a1f-a961-2aac70ca614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c859aa08-658d-4ddd-b53e-a95cf6af6d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:45 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Volume d4d88a88-ca50-4ba8-a92c-150b786d908e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d88a88-ca50-4ba8-a92c-150b786d908e', 'volume_size': 1} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:45 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:46 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.info Sep 08 19:08:46 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Flow 'volume_create_manager' (b8306ef8-7cc0-4f23-8e9f-63178b471096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fdc95f-9256-4d81-b4af-55c29a8bb89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fdc95f-9256-4d81-b4af-55c29a8bb89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-636048774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5ecf61-d853-4455-8a36-9315fa517974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a7fbebdb4d4b9e9f4b4f035de985aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:46Z,use_quota=True,user_id='e9394745c1bb4a5bb6fee92bf763e41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed496290-b217-4ed8-9b5d-24ff98fb6b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed496290-b217-4ed8-9b5d-24ff98fb6b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:46 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da65b78-73e3-45ca-9872-03d6cca742c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da65b78-73e3-45ca-9872-03d6cca742c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5ecf61-d853-4455-8a36-9315fa517974', 'volume_name': 'volume-fb5ecf61-d853-4455-8a36-9315fa517974', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6899344-114d-4376-b13d-e3c9212627da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6899344-114d-4376-b13d-e3c9212627da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec85b848-ec44-4818-89f1-f873cf3d580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:46 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Volume fb5ecf61-d853-4455-8a36-9315fa517974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5ecf61-d853-4455-8a36-9315fa517974', 'volume_size': 1} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.info" returned: 0 in 0.403s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:46 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.info is being set with open permissions: ugo+rw Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:46 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.info Sep 08 19:08:46 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:46 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.info" returned: 0 in 0.263s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952259207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d88a88-ca50-4ba8-a92c-150b786d908e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c732a54f772943a19e136b7269578133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:46Z,use_quota=True,user_id='89c6f534f7cc4f87ad196d68ba314295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Creating volume d4d88a88-ca50-4ba8-a92c-150b786d908e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:46 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:46 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e 1073741824 Sep 08 19:08:46 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2d2ddd1d-6644-4e31-83f9-75e353590212 tempest-VolumesSnapshotTestJSON-830010200 None] Create snapshot completed successfully Sep 08 19:08:47 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e 1073741824" returned: 0 in 0.419s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:47 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e Sep 08 19:08:47 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:47 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e" returned: 0 in 0.269s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-636048774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5ecf61-d853-4455-8a36-9315fa517974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a7fbebdb4d4b9e9f4b4f035de985aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:46Z,use_quota=True,user_id='e9394745c1bb4a5bb6fee92bf763e41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Creating volume fb5ecf61-d853-4455-8a36-9315fa517974 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:47 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c859aa08-658d-4ddd-b53e-a95cf6af6d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d88a88-ca50-4ba8-a92c-150b786d908e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928ff183-e7e7-4090-b626-17684ca77574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:47 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 1073741824 Sep 08 19:08:47 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:47 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Volume volume-d4d88a88-ca50-4ba8-a92c-150b786d908e (d4d88a88-ca50-4ba8-a92c-150b786d908e): created successfully Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928ff183-e7e7-4090-b626-17684ca77574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Flow 'volume_create_manager' (2aeecea2-30de-4459-aa61-7cf0503b8bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:47 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d1a4fbf7-f496-4792-9b51-8e8a4cf97d2e tempest-VolumesListAdminTestJSON-1862555200 None] Created volume successfully. Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:48 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 1073741824" returned: 0 in 0.714s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (3ac204c0-16e2-438a-bc80-cd07c62f4093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad9729-14bd-45d5-8347-a635154e69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad9729-14bd-45d5-8347-a635154e69bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-790599138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53abe988-df8d-4af5-84aa-cfd356282b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bce8c93c794698bff9f765c60b32b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19a49d6a-2841-4c5b-bfa4-cb54221cfe6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:48Z,use_quota=True,user_id='4c6d50d989314f058217cb61b9d95835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78869cda-22a9-436b-b774-5bda21b6cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78869cda-22a9-436b-b774-5bda21b6cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e34ac32-e6df-4151-980d-4df50f876730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e34ac32-e6df-4151-980d-4df50f876730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53abe988-df8d-4af5-84aa-cfd356282b2e', 'volume_name': 'volume-53abe988-df8d-4af5-84aa-cfd356282b2e', 'volume_size': 1, 'snapshot_id': '19a49d6a-2841-4c5b-bfa4-cb54221cfe6c'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996ef6dd-30a4-4c20-9ef5-fed7e451680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996ef6dd-30a4-4c20-9ef5-fed7e451680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22743b5b-b410-44c3-996f-380c7c408f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Volume 53abe988-df8d-4af5-84aa-cfd356282b2e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53abe988-df8d-4af5-84aa-cfd356282b2e', 'volume_size': 1, 'snapshot_id': '19a49d6a-2841-4c5b-bfa4-cb54221cfe6c'} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:48 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 Sep 08 19:08:48 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:48 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974" returned: 0 in 0.261s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.279s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c-53abe988-df8d-4af5-84aa-cfd356282b2e" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec85b848-ec44-4818-89f1-f873cf3d580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5ecf61-d853-4455-8a36-9315fa517974', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ebca12-bf1e-417a-b96d-fc3f3f1dda9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c-53abe988-df8d-4af5-84aa-cfd356282b2e" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Creating volume 53abe988-df8d-4af5-84aa-cfd356282b2e from snapshot 19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-53abe988-df8d-4af5-84aa-cfd356282b2e" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:48 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Volume volume-fb5ecf61-d853-4455-8a36-9315fa517974 (fb5ecf61-d853-4455-8a36-9315fa517974): created successfully Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ebca12-bf1e-417a-b96d-fc3f3f1dda9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Flow 'volume_create_manager' (b8306ef8-7cc0-4f23-8e9f-63178b471096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-53abe988-df8d-4af5-84aa-cfd356282b2e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] snapshot: 19a49d6a-2841-4c5b-bfa4-cb54221cfe6c, volume: 53abe988-df8d-4af5-84aa-cfd356282b2e, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f5a5dd8a-67f9-4933-a164-43be46699e2e tempest-VolumesTransfersTest-491353278 None] Created volume successfully. Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698b23c-1497-46b8-9b06-31c887164708]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Flow 'volume_create_manager' (c16b2e14-6d62-4114-977c-85d99ef91072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb3ff0b-ad9c-450c-aad5-ce1ffde670a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb3ff0b-ad9c-450c-aad5-ce1ffde670a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f59cf7c-ffae-4ea9-9efa-0b22862f7e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f416ae8ae942be9b58e2b99f4cc442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:49Z,use_quota=True,user_id='89322138ef8e439aa9224d74d24c2ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d1bf0b-a44e-4aaa-a0b1-c2250dff6a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d1bf0b-a44e-4aaa-a0b1-c2250dff6a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598cdf0c-076f-4b43-8ab0-2af0d8040139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598cdf0c-076f-4b43-8ab0-2af0d8040139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f59cf7c-ffae-4ea9-9efa-0b22862f7e33', 'volume_name': 'volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a35917-3122-4638-b960-18d86fffd2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a35917-3122-4638-b960-18d86fffd2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a828a1-c8d9-4cf6-b152-50c135533175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:48 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Volume 6f59cf7c-ffae-4ea9-9efa-0b22862f7e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33', 'volume_size': 1} Sep 08 19:08:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:48 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c Sep 08 19:08:48 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:49 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" returned: 0 in 0.361s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-529525dc-986a-42ae-8a1c-d86da90cfa3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cc8421-bfd7-4c71-be5f-34b2871f8ea4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:49 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b Sep 08 19:08:49 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:49 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b" returned: 0 in 0.359s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:08:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:49 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e Sep 08 19:08:49 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:50 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d51303ef-cb58-453d-9e5a-1107ad4800b6 tempest-VolumesTransfersTest-679290824 None] Transfer volume completed successfully. Sep 08 19:08:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Acquiring lock "cinder-fb5ecf61-d853-4455-8a36-9315fa517974-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-fb5ecf61-d853-4455-8a36-9315fa517974-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Acquiring lock "cinder-quobyte-fb5ecf61-d853-4455-8a36-9315fa517974" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-quobyte-fb5ecf61-d853-4455-8a36-9315fa517974" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:52 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d15d0e-c2c8-4cf1-a301-179255b94a4c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:52 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 Sep 08 19:08:52 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:53 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974" returned: 0 in 0.715s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:53 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974 Sep 08 19:08:53 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:53 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fb5ecf61-d853-4455-8a36-9315fa517974" returned: 0 in 0.583s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-quobyte-fb5ecf61-d853-4455-8a36-9315fa517974" released by "delete_volume" :: held 1.384s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Created reservations ['c57243d2-4b33-4151-924e-d0fff88efd13', '54d503c2-8975-4c0b-a389-05cdb78247ac', '17a285d5-78a3-48a3-8794-bd296158b485', '998306ca-14fb-4b67-a2fc-b3d7c8afd3c6'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:53 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:53 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:54 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.470s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:54 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Deleted volume successfully. Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f209cc49-95c9-44e0-8660-6ad46533e1b7 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-fb5ecf61-d853-4455-8a36-9315fa517974-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:54 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e" returned: 0 in 5.053s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:08:54 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Converted 1024.00 MB image at 202.60 MB/s Sep 08 19:08:54 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e is being set with open permissions: ugo+rw Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:54 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e Sep 08 19:08:54 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:54 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e" returned: 0 in 0.260s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-53abe988-df8d-4af5-84aa-cfd356282b2e" released by "_copy_volume_from_snapshot" :: held 6.128s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c-53abe988-df8d-4af5-84aa-cfd356282b2e" released by "_create_volume_from_snapshot" :: held 6.212s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.244s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.016s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f59cf7c-ffae-4ea9-9efa-0b22862f7e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f416ae8ae942be9b58e2b99f4cc442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:49Z,use_quota=True,user_id='89322138ef8e439aa9224d74d24c2ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Creating volume 6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:54 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:54 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 1073741824 Sep 08 19:08:54 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22743b5b-b410-44c3-996f-380c7c408f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53abe988-df8d-4af5-84aa-cfd356282b2e', 'volume_size': 1, 'snapshot_id': '19a49d6a-2841-4c5b-bfa4-cb54221cfe6c'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1defcd4d-a32f-4f5d-8cbe-9445aa510ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:54 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Volume volume-53abe988-df8d-4af5-84aa-cfd356282b2e (53abe988-df8d-4af5-84aa-cfd356282b2e): created successfully Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1defcd4d-a32f-4f5d-8cbe-9445aa510ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Flow 'volume_create_manager' (3ac204c0-16e2-438a-bc80-cd07c62f4093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:54 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0964ae74-e67f-4f0c-b3f6-22c7d956ab40 tempest-VolumesSnapshotTestJSON-830010200 None] Created volume successfully. Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Flow 'volume_create_manager' (83351cd6-acb2-4be8-9b44-de53c18c9778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81c5ecc-1784-42ab-a995-0d8c2be1cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81c5ecc-1784-42ab-a995-0d8c2be1cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1205655833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef4ce4c-acb4-4590-a6e2-27e145afad34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a7fbebdb4d4b9e9f4b4f035de985aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:55Z,use_quota=True,user_id='e9394745c1bb4a5bb6fee92bf763e41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7369979f-1479-45e1-bea2-dedf3c017cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7369979f-1479-45e1-bea2-dedf3c017cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217d6646-67f5-42af-9bdd-2a1cafe6cbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217d6646-67f5-42af-9bdd-2a1cafe6cbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef4ce4c-acb4-4590-a6e2-27e145afad34', 'volume_name': 'volume-eef4ce4c-acb4-4590-a6e2-27e145afad34', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6832ca48-cd3c-44ef-8ec9-b797a15acc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6832ca48-cd3c-44ef-8ec9-b797a15acc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac6a981-1119-4407-820b-3c03d51abd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:55 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Volume eef4ce4c-acb4-4590-a6e2-27e145afad34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef4ce4c-acb4-4590-a6e2-27e145afad34', 'volume_size': 1} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:55 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 1073741824" returned: 0 in 0.553s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:55 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 Sep 08 19:08:55 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:55 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33" returned: 0 in 0.240s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.359s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1205655833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef4ce4c-acb4-4590-a6e2-27e145afad34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10a7fbebdb4d4b9e9f4b4f035de985aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:55Z,use_quota=True,user_id='e9394745c1bb4a5bb6fee92bf763e41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Creating volume eef4ce4c-acb4-4590-a6e2-27e145afad34 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:55 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:55 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 1073741824 Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a828a1-c8d9-4cf6-b152-50c135533175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:55 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e870a62d-9d51-48c3-a16c-968e56c3d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:55 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Volume volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 (6f59cf7c-ffae-4ea9-9efa-0b22862f7e33): created successfully Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e870a62d-9d51-48c3-a16c-968e56c3d962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Flow 'volume_create_manager' (c16b2e14-6d62-4114-977c-85d99ef91072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-da9a174f-5cc2-43b9-9137-f4a12b072269 tempest-VolumesListAdminTestJSON-385388915 None] Created volume successfully. Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-53abe988-df8d-4af5-84aa-cfd356282b2e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-53abe988-df8d-4af5-84aa-cfd356282b2e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-53abe988-df8d-4af5-84aa-cfd356282b2e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-53abe988-df8d-4af5-84aa-cfd356282b2e" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0decf785-865b-43f8-88a4-91d0a980858e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:56 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e Sep 08 19:08:56 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:56 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 1073741824" returned: 0 in 0.513s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:56 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 Sep 08 19:08:56 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:56 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:56 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e Sep 08 19:08:56 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:56 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34" returned: 0 in 0.283s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac6a981-1119-4407-820b-3c03d51abd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef4ce4c-acb4-4590-a6e2-27e145afad34', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43f64b3-da79-4d71-a984-70987c797e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:56 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Volume volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 (eef4ce4c-acb4-4590-a6e2-27e145afad34): created successfully Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43f64b3-da79-4d71-a984-70987c797e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Flow 'volume_create_manager' (83351cd6-acb2-4be8-9b44-de53c18c9778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Acquiring lock "cinder-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6b4e41bd-2dbe-4814-b48a-52253a8b5362 tempest-VolumesTransfersTest-491353278 None] Created volume successfully. Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Lock "cinder-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Acquiring lock "cinder-quobyte-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Lock "cinder-quobyte-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[01750ce7-4f71-49e7-94e2-5d765edd8a3a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "cinder-d4d88a88-ca50-4ba8-a92c-150b786d908e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-d4d88a88-ca50-4ba8-a92c-150b786d908e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:56 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-53abe988-df8d-4af5-84aa-cfd356282b2e" returned: 0 in 0.378s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "cinder-quobyte-d4d88a88-ca50-4ba8-a92c-150b786d908e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-53abe988-df8d-4af5-84aa-cfd356282b2e" released by "delete_volume" :: held 0.859s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-quobyte-d4d88a88-ca50-4ba8-a92c-150b786d908e" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6950ae5a-0660-4854-804a-3a68f544bd23]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:56 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 Sep 08 19:08:56 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:56 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['cd286b89-0dc6-4c37-a59b-e481e46ce7cd', 'e259dd99-f54c-4541-9773-af22fc8585cf', 'f533bb0a-dc06-486a-b8d2-46762a22fba0', 'a44f99f7-2234-439c-81a5-a7d39033e6bd'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:57 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e Sep 08 19:08:57 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:57 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:57 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-529525dc-986a-42ae-8a1c-d86da90cfa3b" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:57 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33" returned: 0 in 0.639s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-529525dc-986a-42ae-8a1c-d86da90cfa3b" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Deleting offline snapshot 19a49d6a-2841-4c5b-bfa4-cb54221cfe6c of volume 529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:08:57 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33 Sep 08 19:08:57 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] snapshot_file for this snap is: volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:08:57 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.387s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0456a6ae-31cc-4ac7-a8d4-c2a0431bdd37]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:57 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Deleted volume successfully. Sep 08 19:08:57 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e" returned: 0 in 0.566s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ee3fec33-febb-46c7-87ad-950f25b27f72 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-53abe988-df8d-4af5-84aa-cfd356282b2e-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:57 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e Sep 08 19:08:57 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:57 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c Sep 08 19:08:57 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:57 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33" returned: 0 in 0.339s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Acquiring lock "cinder-eef4ce4c-acb4-4590-a6e2-27e145afad34-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Lock "cinder-quobyte-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33" released by "delete_volume" :: held 1.077s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-eef4ce4c-acb4-4590-a6e2-27e145afad34-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Acquiring lock "cinder-quobyte-eef4ce4c-acb4-4590-a6e2-27e145afad34" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Created reservations ['870c3201-6f4f-409c-8284-6189d683e811', '06b20d0c-2f86-4600-82b2-a883b7bc5a33', '1d1e664b-9bfe-4292-870f-99c8773fc5d9', '7b0bacc2-c7e0-435d-941b-ed9a7a40d299'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:57 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-quobyte-eef4ce4c-acb4-4590-a6e2-27e145afad34" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d4d88a88-ca50-4ba8-a92c-150b786d908e" returned: 0 in 0.413s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b81ad5-7378-4236-9381-1d810483c6ee]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-quobyte-d4d88a88-ca50-4ba8-a92c-150b786d908e" released by "delete_volume" :: held 1.049s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:58 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" returned: 0 in 0.556s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-529525dc-986a-42ae-8a1c-d86da90cfa3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73d5fd6-8f59-4abc-81bb-5a1f166ca034]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:58 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 Sep 08 19:08:58 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Created reservations ['4628066f-621e-4cb2-9340-667656765514', '84b6ef9b-9996-4f99-9255-a41800a9c287', '2d204390-3e18-46cc-bb91-2c8a3de78f79', 'c12a0f91-845f-4dd5-9ebc-ba481e08b9dd'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:58 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:58 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:58 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b Sep 08 19:08:58 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:58 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:58 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:58 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34" returned: 0 in 0.500s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:58 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34 Sep 08 19:08:58 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:58 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.388s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Deleted volume successfully. Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-99d9e8ca-df34-4602-92ab-3b14fcc63abb tempest-VolumesListAdminTestJSON-385388915 None] Lock "cinder-6f59cf7c-ffae-4ea9-9efa-0b22862f7e33-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:58 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.360s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Deleted volume successfully. Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-475f6b29-ff28-4d06-8b07-fd14e08705d7 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-d4d88a88-ca50-4ba8-a92c-150b786d908e-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Flow 'volume_create_manager' (0cd3e8e5-f293-4dac-b447-180dd2b73c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea675616-74de-4b86-ac97-d77f44c05af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea675616-74de-4b86-ac97-d77f44c05af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1271758737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b339e-4d42-4c94-9955-78cf801cacec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5bba3142f4b47aa7a296d62db0708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:59Z,use_quota=True,user_id='cea4c6ffd88941a2ac2a264115bca8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56613411-4fe1-4648-847a-0406345c9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56613411-4fe1-4648-847a-0406345c9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8481246f-fb85-42d2-a48c-710f4cc9cf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8481246f-fb85-42d2-a48c-710f4cc9cf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188b339e-4d42-4c94-9955-78cf801cacec', 'volume_name': 'volume-188b339e-4d42-4c94-9955-78cf801cacec', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc15c48f-3a50-4fbe-b276-7848f51c0d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc15c48f-3a50-4fbe-b276-7848f51c0d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba17df2-9db0-4db4-b3de-08df21842a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:58 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Volume 188b339e-4d42-4c94-9955-78cf801cacec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188b339e-4d42-4c94-9955-78cf801cacec', 'volume_size': 1} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1271758737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188b339e-4d42-4c94-9955-78cf801cacec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5bba3142f4b47aa7a296d62db0708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:08:59Z,use_quota=True,user_id='cea4c6ffd88941a2ac2a264115bca8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Creating volume 188b339e-4d42-4c94-9955-78cf801cacec {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:58 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:08:58 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eef4ce4c-acb4-4590-a6e2-27e145afad34" returned: 0 in 0.342s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:58 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec 1073741824 Sep 08 19:08:58 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-quobyte-eef4ce4c-acb4-4590-a6e2-27e145afad34" released by "delete_volume" :: held 0.907s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Created reservations ['c2d678f2-d948-4747-88c5-3de26affc55d', 'c00bde17-f854-4944-b9a2-3b53a329ea5a', '9b69dc0c-05d0-4d4f-bc88-3e7f5859aac8', 'a93a8c2a-34a3-458c-9d5e-e16f47c75bc7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:58 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b" returned: 0 in 0.854s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:58 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c Sep 08 19:08:58 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:58 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:08:58 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "cinder-9a9e999f-496c-45f7-9b2f-faa279fc8cd2-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-9a9e999f-496c-45f7-9b2f-faa279fc8cd2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:59 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec 1073741824" returned: 0 in 0.502s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "cinder-quobyte-9a9e999f-496c-45f7-9b2f-faa279fc8cd2" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:08:59 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.332s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:08:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Deleted volume successfully. Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-quobyte-9a9e999f-496c-45f7-9b2f-faa279fc8cd2" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:08:59 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" returned: 0 in 0.430s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcb4956-b67f-464e-91f4-a10b090b2b0f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:59 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c Sep 08 19:08:59 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c5052851-f4e0-48db-83e8-83ba52d8c400 tempest-VolumesTransfersTest-1804890380 None] Lock "cinder-eef4ce4c-acb4-4590-a6e2-27e145afad34-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:59 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec Sep 08 19:08:59 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:59 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 Sep 08 19:08:59 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:59 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b.19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" returned: 0 in 0.283s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:59 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c" released by "_delete_snapshot" :: held 2.261s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-529525dc-986a-42ae-8a1c-d86da90cfa3b" released by "delete_snapshot" :: held 2.291s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba17df2-9db0-4db4-b3de-08df21842a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188b339e-4d42-4c94-9955-78cf801cacec', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c9b64a-8912-410f-b94d-588751a66b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:08:59 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Volume volume-188b339e-4d42-4c94-9955-78cf801cacec (188b339e-4d42-4c94-9955-78cf801cacec): created successfully Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c9b64a-8912-410f-b94d-588751a66b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:08:59 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Flow 'volume_create_manager' (0cd3e8e5-f293-4dac-b447-180dd2b73c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2" returned: 0 in 0.386s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:08:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8fff216a-3032-4d28-9f20-5bdcf789c577 tempest-AttachVolumeNegativeTest-1988327816 None] Created volume successfully. Sep 08 19:08:59 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2 Sep 08 19:08:59 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['eca53090-eba8-41bf-8feb-145694db6958', 'e2e3103f-60c3-45cc-aa17-f981c25c5c78', 'ff9e1d59-0923-44ee-a3db-6847e41c7dba', '801420d5-58fb-46dd-806a-1b0161f2c801'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:08:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Delete snapshot completed successfully. Sep 08 19:08:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ba322342-5730-4661-a999-91c2c2eff4ed tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-19a49d6a-2841-4c5b-bfa4-cb54221cfe6c-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:00 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9a9e999f-496c-45f7-9b2f-faa279fc8cd2" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-quobyte-9a9e999f-496c-45f7-9b2f-faa279fc8cd2" released by "delete_volume" :: held 0.717s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Created reservations ['140addad-b38b-487a-bf06-8c3bc30fc8d9', '485aee2f-67a5-4a53-8d34-3051d58c56f4', 'b781a38b-b8fb-4c4e-b734-02def3051718', '3051c9eb-7c4c-41a8-b76d-e2e784f8ce42'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:00 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:00 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:00 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Deleted volume successfully. Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "cinder-9ae31d31-8568-4900-b2db-6c62b6c4e94a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-913e2e02-371a-44d4-a863-c246d69151d1 tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-9a9e999f-496c-45f7-9b2f-faa279fc8cd2-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-9ae31d31-8568-4900-b2db-6c62b6c4e94a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "cinder-quobyte-9ae31d31-8568-4900-b2db-6c62b6c4e94a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-quobyte-9ae31d31-8568-4900-b2db-6c62b6c4e94a" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece63db-022e-442d-898f-a5254ab29c40]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-529525dc-986a-42ae-8a1c-d86da90cfa3b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-529525dc-986a-42ae-8a1c-d86da90cfa3b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:00 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a Sep 08 19:09:00 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-529525dc-986a-42ae-8a1c-d86da90cfa3b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-529525dc-986a-42ae-8a1c-d86da90cfa3b" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc7faa5-ff18-4ef8-a59c-26011b44384d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:00 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b Sep 08 19:09:00 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:01 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a" returned: 0 in 0.509s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:01 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a Sep 08 19:09:01 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:01 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b" returned: 0 in 0.498s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:01 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b Sep 08 19:09:01 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:01 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9ae31d31-8568-4900-b2db-6c62b6c4e94a" returned: 0 in 0.302s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-quobyte-9ae31d31-8568-4900-b2db-6c62b6c4e94a" released by "delete_volume" :: held 0.870s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Created reservations ['e503a79f-f274-49b5-a90e-7e1e8c38de0d', '5953e4fb-929a-455c-8570-2c1422299374', '81d28c1e-be13-4227-a4ab-f36e93fad505', '1ec64aac-59d1-4c92-a47e-f1b05ba6b4c2'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:01 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:01 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:01 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-529525dc-986a-42ae-8a1c-d86da90cfa3b" returned: 0 in 0.366s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-529525dc-986a-42ae-8a1c-d86da90cfa3b" released by "delete_volume" :: held 0.972s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['8669ef64-c064-477e-8ac3-a22477fa2ad5', '307960b2-4141-4254-9230-14ef6071a932', '88ba2c32-00cb-4098-be31-979218bf3d09', 'a811b3bb-b66a-4f1f-bb1c-50b79e32b39f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:01 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:01 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:01 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Deleted volume successfully. Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-568299a0-2e95-4ff7-82e1-58ac6fd11271 req-e5233554-ebe1-4c47-9544-9261becceccd tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-568299a0-2e95-4ff7-82e1-58ac6fd11271 req-e5233554-ebe1-4c47-9544-9261becceccd tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2f65357f-bf95-43ec-be52-463177be083f tempest-VolumesListAdminTestJSON-1862555200 None] Lock "cinder-9ae31d31-8568-4900-b2db-6c62b6c4e94a-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-568299a0-2e95-4ff7-82e1-58ac6fd11271 req-e5233554-ebe1-4c47-9544-9261becceccd tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-568299a0-2e95-4ff7-82e1-58ac6fd11271 req-e5233554-ebe1-4c47-9544-9261becceccd tempest-AttachVolumeNegativeTest-1988327816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-188b339e-4d42-4c94-9955-78cf801cacec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd989b76e-dee5-46d6-a9bf-e7b33cdeb0d4', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:09:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-568299a0-2e95-4ff7-82e1-58ac6fd11271 req-e5233554-ebe1-4c47-9544-9261becceccd tempest-AttachVolumeNegativeTest-1988327816 None] attachment_update completed successfully. Sep 08 19:09:02 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.369s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Deleted volume successfully. Sep 08 19:09:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-59884e7a-3af0-42e7-a9fd-653b8ca782b1 tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-529525dc-986a-42ae-8a1c-d86da90cfa3b-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-4ad9589e-9777-4af8-baff-624151246c33-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-4ad9589e-9777-4af8-baff-624151246c33-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "cinder-quobyte-4ad9589e-9777-4af8-baff-624151246c33" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-4ad9589e-9777-4af8-baff-624151246c33" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdd6c75-f1e3-4078-8265-88455f3fbd23]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:03 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 Sep 08 19:09:03 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:03 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33" returned: 0 in 0.425s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:03 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33 Sep 08 19:09:03 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:04 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-4ad9589e-9777-4af8-baff-624151246c33" returned: 0 in 0.348s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-quobyte-4ad9589e-9777-4af8-baff-624151246c33" released by "delete_volume" :: held 0.858s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Created reservations ['25670b15-c0b7-4b62-b6af-d8623204ba9f', 'd8dd535e-5647-4790-ade7-3feeb8647dbb', '8f7f2834-e346-48e2-baee-1397b04614db', '1a7107cb-b5b7-4cc4-8501-d0d83af70549'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:04 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:04 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:04 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.344s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Deleted volume successfully. Sep 08 19:09:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9726c1f8-d2d4-4832-aad7-e652d60d290d tempest-VolumesSnapshotTestJSON-830010200 None] Lock "cinder-4ad9589e-9777-4af8-baff-624151246c33-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Flow 'volume_create_manager' (fa8b1f6c-38d0-4e96-b532-d07049c1f4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881003a9-1a64-47e8-8bc6-44148ef48be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881003a9-1a64-47e8-8bc6-44148ef48be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1720929953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814b3c19-8a03-4487-aff5-27ea4f4c27ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d257f5a954a8ca2dc622f66b5dfad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:09Z,use_quota=True,user_id='80846ba58ea443f9a2438db9fdaac0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c748f53-5c01-418a-91df-86cc85d12375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c748f53-5c01-418a-91df-86cc85d12375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9389c057-3452-4dea-bd72-52fc0c38611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9389c057-3452-4dea-bd72-52fc0c38611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '814b3c19-8a03-4487-aff5-27ea4f4c27ff', 'volume_name': 'volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed79f075-109c-4d8f-b485-44a3f6d72f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed79f075-109c-4d8f-b485-44a3f6d72f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2e7762-ad56-4d4c-a529-38494cf5becf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:09 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Volume 814b3c19-8a03-4487-aff5-27ea4f4c27ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:09:09 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Trying to clone 814b3c19-8a03-4487-aff5-27ea4f4c27ff from image 8499e13e-f314-4011-953c-7c51abb2061c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:09:10 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:09:10 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:09:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[daecd896-6878-4f19-a068-3b8d9e543bb1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:10 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD Sep 08 19:09:10 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:10 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:10 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c is fetched for user 80846ba58ea443f9a2438db9fdaac0f3. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:09:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0426610-9712-4c35-a45d-cd7810ba3bb2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:11 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD Sep 08 19:09:11 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:11 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1720929953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814b3c19-8a03-4487-aff5-27ea4f4c27ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a1d257f5a954a8ca2dc622f66b5dfad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:09Z,use_quota=True,user_id='80846ba58ea443f9a2438db9fdaac0f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Creating volume 814b3c19-8a03-4487-aff5-27ea4f4c27ff {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:09:11 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:09:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:11 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff 1073741824 Sep 08 19:09:11 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:12 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff 1073741824" returned: 0 in 0.727s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:12 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff Sep 08 19:09:12 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:12 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff" returned: 0 in 0.499s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Attempting download of 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 814b3c19-8a03-4487-aff5-27ea4f4c27ff. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ea431e-099e-4db5-a7ba-845450bd53a0]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_cfdaxjqg {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:13 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_cfdaxjqg Sep 08 19:09:13 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:13 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_cfdaxjqg" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_cfdaxjqg {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:13 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_cfdaxjqg Sep 08 19:09:13 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:13 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_cfdaxjqg" returned: 1 in 0.541s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_cfdaxjqg' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:09:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad95d1-3148-44e5-9672-67481b1f94ca]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:14 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD Sep 08 19:09:14 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:14 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] 8499e13e-f314-4011-953c-7c51abb2061c was qcow2, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:14 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff Sep 08 19:09:14 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Flow 'volume_create_manager' (707a694f-2746-4154-ab2b-6306117bc184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e624af2-2d3f-4419-9f9a-7ad62a41514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e624af2-2d3f-4419-9f9a-7ad62a41514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-471331251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6e8d94-e625-4355-8043-fd3a726d4f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5efa2f553b046fda3a048ad421d80cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:15Z,use_quota=True,user_id='fb0702ab83ee4f4686a54c249602aaf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243cf59-a200-4cbe-96ff-6b5d2caf6ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243cf59-a200-4cbe-96ff-6b5d2caf6ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c15eb-6b33-4460-ba98-02703f546376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92c15eb-6b33-4460-ba98-02703f546376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6e8d94-e625-4355-8043-fd3a726d4f52', 'volume_name': 'volume-2d6e8d94-e625-4355-8043-fd3a726d4f52', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1848c7a7-fb3c-4423-ba32-8c23416c23ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1848c7a7-fb3c-4423-ba32-8c23416c23ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343872a6-6962-45ae-89d1-f93022e12a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:15 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Volume 2d6e8d94-e625-4355-8043-fd3a726d4f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6e8d94-e625-4355-8043-fd3a726d4f52', 'volume_size': 1} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-471331251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6e8d94-e625-4355-8043-fd3a726d4f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5efa2f553b046fda3a048ad421d80cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:15Z,use_quota=True,user_id='fb0702ab83ee4f4686a54c249602aaf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Creating volume 2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:09:15 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:15 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 1073741824 Sep 08 19:09:15 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:15 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 1073741824" returned: 0 in 0.661s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:15 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 Sep 08 19:09:15 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:16 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52" returned: 0 in 0.371s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (343872a6-6962-45ae-89d1-f93022e12a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6e8d94-e625-4355-8043-fd3a726d4f52', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24171ce9-47f2-43b4-9410-f7b7b4e46bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:16 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Volume volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 (2d6e8d94-e625-4355-8043-fd3a726d4f52): created successfully Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24171ce9-47f2-43b4-9410-f7b7b4e46bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Flow 'volume_create_manager' (707a694f-2746-4154-ab2b-6306117bc184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a3df5b63-5965-4566-9866-189e68c14847 tempest-VolumesSnapshotListTestJSON-1222538585 None] Created volume successfully. Sep 08 19:09:16 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff" returned: 0 in 2.704s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_l5aiegy5devstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:09:16 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Converted 112.00 MB image at 41.37 MB/s Sep 08 19:09:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:17 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff 1G Sep 08 19:09:17 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Creating offline snapshot 7872ae62-a213-4e57-8b2e-214e1edf5e4c of volume 2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e7d03-e003-4caa-99c8-d992344dad16]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:17 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff 1G" returned: 0 in 0.598s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Downloaded image 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 814b3c19-8a03-4487-aff5-27ea4f4c27ff successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c for user 80846ba58ea443f9a2438db9fdaac0f3 is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Marking volume 814b3c19-8a03-4487-aff5-27ea4f4c27ff as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:09:17 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 Sep 08 19:09:17 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Copying metadata from image 8499e13e-f314-4011-953c-7c51abb2061c to 814b3c19-8a03-4487-aff5-27ea4f4c27ff. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Creating volume glance metadata for volume 814b3c19-8a03-4487-aff5-27ea4f4c27ff backed by image 8499e13e-f314-4011-953c-7c51abb2061c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2e7762-ad56-4d4c-a529-38494cf5becf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67009e47-6a6e-4e5d-9936-747bc663fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:17 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Volume volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff (814b3c19-8a03-4487-aff5-27ea4f4c27ff): created successfully Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67009e47-6a6e-4e5d-9936-747bc663fc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Flow 'volume_create_manager' (fa8b1f6c-38d0-4e96-b532-d07049c1f4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:17 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0f468185-734d-44c3-b7df-5bb0cdb986d2 tempest-VolumesImageMetadata-1004486877 None] Created volume successfully. Sep 08 19:09:17 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52" returned: 0 in 0.521s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:18 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c 1G Sep 08 19:09:18 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:18 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c 1G" returned: 0 in 0.503s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:18 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c Sep 08 19:09:18 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:18 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:18 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c is being set with open permissions: ugo+rw Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Acquiring lock "cinder-814b3c19-8a03-4487-aff5-27ea4f4c27ff-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:18 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c Sep 08 19:09:18 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Lock "cinder-814b3c19-8a03-4487-aff5-27ea4f4c27ff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Acquiring lock "cinder-quobyte-814b3c19-8a03-4487-aff5-27ea4f4c27ff" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Lock "cinder-quobyte-814b3c19-8a03-4487-aff5-27ea4f4c27ff" acquired by "delete_volume" :: waited 0.037s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f29ad87-13d6-4704-a013-e1a7f33ff6aa]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c" returned: 0 in 0.346s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff Sep 08 19:09:19 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.info Sep 08 19:09:19 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:19 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff" returned: 0 in 0.535s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.info" returned: 0 in 0.398s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.info is being set with open permissions: ugo+rw Sep 08 19:09:19 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff Sep 08 19:09:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:19 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.info Sep 08 19:09:19 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:20 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-814b3c19-8a03-4487-aff5-27ea4f4c27ff" returned: 0 in 0.469s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.info" returned: 0 in 0.440s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Lock "cinder-quobyte-814b3c19-8a03-4487-aff5-27ea4f4c27ff" released by "delete_volume" :: held 1.111s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a1f60f28-2eb4-4cf3-a352-0fc8f54e8dcd tempest-VolumesSnapshotListTestJSON-1222538585 None] Create snapshot completed successfully Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Created reservations ['b24de7bc-d021-435e-871d-c99265b70eb6', '2e64af51-bfa3-44ca-a548-1ab1b30bd046', '97c86abc-43bb-4b33-9e0d-3cf1251d475a', 'b93e5d4f-daf1-4b69-a633-50d1b9c39de6'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:20 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:20 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:20 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Deleted volume successfully. Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4477b335-340b-48dd-af6a-89492329ac37 tempest-VolumesImageMetadata-1004486877 None] Lock "cinder-814b3c19-8a03-4487-aff5-27ea4f4c27ff-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Creating offline snapshot 84561160-7234-4391-aafe-c7d02059b413 of volume 2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:09:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a6568f-e452-4898-b1c4-c7001e1a765c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:21 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c Sep 08 19:09:21 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:21 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c" returned: 0 in 0.769s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6e8d94-e625-4355-8043-fd3a726d4f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:21 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 1G Sep 08 19:09:21 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:22 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 1G" returned: 0 in 0.719s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:22 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 Sep 08 19:09:22 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:23 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413" returned: 0 in 0.490s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:23 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 is being set with open permissions: ugo+rw Sep 08 19:09:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:23 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 Sep 08 19:09:23 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:23 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413" returned: 0 in 0.356s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c31f01cd-a7fb-4ae0-9dbd-8f2660a79712 tempest-VolumesSnapshotListTestJSON-1222538585 None] Create snapshot completed successfully Sep 08 19:09:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Creating offline snapshot c2ae3ee8-86d4-4f35-8457-9c804dd5328b of volume 2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:09:24 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[64919c0f-7f82-4db5-ae65-e2fd68c8ffe9]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:24 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 Sep 08 19:09:24 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:25 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413" returned: 0 in 0.599s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6e8d94-e625-4355-8043-fd3a726d4f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:25 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b 1G Sep 08 19:09:25 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:26 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b 1G" returned: 0 in 0.951s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:26 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b Sep 08 19:09:26 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:26 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b" returned: 0 in 0.525s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:26 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b is being set with open permissions: ugo+rw Sep 08 19:09:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:26 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b Sep 08 19:09:26 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:27 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b" returned: 0 in 0.514s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6d3fc177-3300-4582-8415-da359086f41e tempest-VolumesSnapshotListTestJSON-1222538585 None] Create snapshot completed successfully Sep 08 19:09:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-c2ae3ee8-86d4-4f35-8457-9c804dd5328b-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-c2ae3ee8-86d4-4f35-8457-9c804dd5328b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-quobyte-c2ae3ee8-86d4-4f35-8457-9c804dd5328b" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:29 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Flow 'volume_create_manager' (e66bb67f-01f5-4ebe-9632-c8386b88893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa736871-3af7-4a74-95f3-04f902879fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-c2ae3ee8-86d4-4f35-8457-9c804dd5328b" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Deleting offline snapshot c2ae3ee8-86d4-4f35-8457-9c804dd5328b of volume 2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] snapshot_file for this snap is: volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa736871-3af7-4a74-95f3-04f902879fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1495468069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bd74e5-a925-41b7-8d46-f6ad5068ed8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd1468c2084bd8a5fe6a39cb5a8c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:30Z,use_quota=True,user_id='ff689b52cea3471ab410b574d998ab46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796d7c7c-f9b6-485e-88c1-ecf09848395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796d7c7c-f9b6-485e-88c1-ecf09848395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468d58e6-725f-479c-b365-a00f0188f2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468d58e6-725f-479c-b365-a00f0188f2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8bd74e5-a925-41b7-8d46-f6ad5068ed8a', 'volume_name': 'volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d633bd37-431c-4527-ab94-10f0db858fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d633bd37-431c-4527-ab94-10f0db858fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627b2b7b-3bc6-4d7c-8983-3f51ba7499d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:30 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Volume b8bd74e5-a925-41b7-8d46-f6ad5068ed8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a', 'volume_size': 1} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1495468069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bd74e5-a925-41b7-8d46-f6ad5068ed8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd1468c2084bd8a5fe6a39cb5a8c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:30Z,use_quota=True,user_id='ff689b52cea3471ab410b574d998ab46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Creating volume b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:09:30 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750a35e-1851-41f6-9df4-2081caa0d0a8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:30 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a 1073741824 Sep 08 19:09:30 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:30 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b Sep 08 19:09:30 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:30 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b" returned: 0 in 0.445s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6e8d94-e625-4355-8043-fd3a726d4f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[61821994-455d-473d-9a74-417186097b1e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:30 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a 1073741824" returned: 0 in 0.577s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:30 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 Sep 08 19:09:30 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:30 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a Sep 08 19:09:30 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:31 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627b2b7b-3bc6-4d7c-8983-3f51ba7499d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:31 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4335791d-fde9-4293-97f2-0ca5ee5fe7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413" returned: 0 in 0.583s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6e8d94-e625-4355-8043-fd3a726d4f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Volume volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a (b8bd74e5-a925-41b7-8d46-f6ad5068ed8a): created successfully Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4335791d-fde9-4293-97f2-0ca5ee5fe7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:31 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b Sep 08 19:09:31 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Flow 'volume_create_manager' (e66bb67f-01f5-4ebe-9632-c8386b88893a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5505c6c5-4859-4d70-8c1c-e15c12753596 tempest-SnapshotMetadataTestJSON-841646939 None] Created volume successfully. Sep 08 19:09:31 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b" returned: 0 in 0.448s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:31 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b Sep 08 19:09:31 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:31 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.c2ae3ee8-86d4-4f35-8457-9c804dd5328b" returned: 0 in 0.284s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-c2ae3ee8-86d4-4f35-8457-9c804dd5328b" released by "_delete_snapshot" :: held 1.948s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" released by "delete_snapshot" :: held 2.025s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=168,cinder:SELECT=139,cinder:INSERT=41,cinder:DELETE=16 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=126,cinder:INSERT=48,cinder:UPDATE=161,cinder:DELETE=15 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Created reservations ['6645ec1a-c837-4398-90a2-f71057873841', '28d51f12-7b75-4463-9398-79b77843028f', 'd2f95b83-7abf-4809-beb0-7a74247aa74f', '99c674a0-7f4a-4093-a87a-4ed927a0bfca'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Delete snapshot completed successfully. Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-32cbb319-2ef7-45ce-9f97-626fa1e406d4 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-c2ae3ee8-86d4-4f35-8457-9c804dd5328b-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Creating offline snapshot 5ab66c66-85b6-4493-be7a-e510db188ef2 of volume b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2c9a95-d6e8-4187-81e0-95aa7e018ee0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:32 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a Sep 08 19:09:32 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:33 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" returned: 0 in 0.581s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:33 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 1G Sep 08 19:09:33 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-84561160-7234-4391-aafe-c7d02059b413-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-84561160-7234-4391-aafe-c7d02059b413-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-quobyte-84561160-7234-4391-aafe-c7d02059b413" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-84561160-7234-4391-aafe-c7d02059b413" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Deleting offline snapshot 84561160-7234-4391-aafe-c7d02059b413 of volume 2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] snapshot_file for this snap is: volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[32af44b9-96d5-4128-bab8-7cc5ffbb9f5b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:33 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 Sep 08 19:09:33 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:33 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 1G" returned: 0 in 0.470s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:33 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 Sep 08 19:09:33 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:33 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413" returned: 0 in 0.448s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6e8d94-e625-4355-8043-fd3a726d4f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c32240-7903-41b1-8302-0410b5ed3906]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:33 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2" returned: 0 in 0.325s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:33 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 is being set with open permissions: ugo+rw Sep 08 19:09:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:33 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 Sep 08 19:09:33 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:33 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c Sep 08 19:09:33 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:34 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:34 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.info Sep 08 19:09:34 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:34 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c" returned: 0 in 0.392s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6e8d94-e625-4355-8043-fd3a726d4f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:34 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 Sep 08 19:09:34 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:34 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:34 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:34 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.info" returned: 0 in 0.289s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:34 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.info is being set with open permissions: ugo+rw Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:34 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.info Sep 08 19:09:34 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:34 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 28 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:09:34 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.info" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:34 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413" returned: 0 in 0.562s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a44cd9af-973c-49aa-b743-1fc55616fa78 tempest-SnapshotMetadataTestJSON-841646939 None] Create snapshot completed successfully Sep 08 19:09:34 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413 Sep 08 19:09:34 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:35 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.84561160-7234-4391-aafe-c7d02059b413" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-84561160-7234-4391-aafe-c7d02059b413" released by "_delete_snapshot" :: held 1.790s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" released by "delete_snapshot" :: held 1.820s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Created reservations ['11c862cb-587c-491a-a546-b4be65d19542', '689ec75b-e976-42f1-8b3a-ab2e068925d6', '892cf84e-fea3-40c7-83b0-c9510fc8d75a', 'cd1b8411-87e5-4e68-af91-8ee922c07de0'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Delete snapshot completed successfully. Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5678b7ea-e2a1-4a03-a764-77d59f25984f tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-84561160-7234-4391-aafe-c7d02059b413-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-7872ae62-a213-4e57-8b2e-214e1edf5e4c-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-7872ae62-a213-4e57-8b2e-214e1edf5e4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-quobyte-7872ae62-a213-4e57-8b2e-214e1edf5e4c" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-7872ae62-a213-4e57-8b2e-214e1edf5e4c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Deleting offline snapshot 7872ae62-a213-4e57-8b2e-214e1edf5e4c of volume 2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] snapshot_file for this snap is: volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f0431-6e75-48ca-95f8-f6eed414ebdb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:35 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c Sep 08 19:09:35 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:36 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c" returned: 0 in 0.459s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d6e8d94-e625-4355-8043-fd3a726d4f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[808368b6-4a6e-437f-8646-db2d584e72a3]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:36 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 Sep 08 19:09:36 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "cinder-5ab66c66-85b6-4493-be7a-e510db188ef2-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-5ab66c66-85b6-4493-be7a-e510db188ef2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "cinder-quobyte-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-quobyte-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "cinder-quobyte-5ab66c66-85b6-4493-be7a-e510db188ef2" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-quobyte-5ab66c66-85b6-4493-be7a-e510db188ef2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Deleting offline snapshot 5ab66c66-85b6-4493-be7a-e510db188ef2 of volume b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] snapshot_file for this snap is: volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b9331-5474-45dd-af5f-959d0d1dcb52]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:36 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52" returned: 0 in 0.443s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:36 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c Sep 08 19:09:36 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:36 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 Sep 08 19:09:36 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:36 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:36 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c" returned: 0 in 0.427s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2" returned: 0 in 0.462s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:09:36 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c Sep 08 19:09:36 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e217a0d8-ea0f-4097-bffc-f04b0c02d7e6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:37 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a Sep 08 19:09:37 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:37 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52.7872ae62-a213-4e57-8b2e-214e1edf5e4c" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-7872ae62-a213-4e57-8b2e-214e1edf5e4c" released by "_delete_snapshot" :: held 1.735s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" released by "delete_snapshot" :: held 1.768s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Created reservations ['9ceea628-5332-4aa0-80fb-b4350d8b66fa', '2f30d048-19e9-42e5-8951-4b56f21f0033', '5aa6f11c-46ea-4122-8a0b-37231c970903', '87bd1697-e0ce-4341-a914-c1a4426ec688'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Delete snapshot completed successfully. Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d76216a-b248-455d-a477-07df17ed06e9 tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-7872ae62-a213-4e57-8b2e-214e1edf5e4c-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:37 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" returned: 0 in 0.438s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:37 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 Sep 08 19:09:37 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-2d6e8d94-e625-4355-8043-fd3a726d4f52-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-2d6e8d94-e625-4355-8043-fd3a726d4f52-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d494a06-6918-4bc4-b95b-02cd0a32c26f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:37 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2" returned: 0 in 0.445s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:37 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2 Sep 08 19:09:37 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:38 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 Sep 08 19:09:38 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:38 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a.5ab66c66-85b6-4493-be7a-e510db188ef2" returned: 0 in 0.283s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-quobyte-5ab66c66-85b6-4493-be7a-e510db188ef2" released by "_delete_snapshot" :: held 1.767s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-quobyte-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" released by "delete_snapshot" :: held 1.804s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:38 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52" returned: 0 in 0.389s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:38 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52 Sep 08 19:09:38 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Created reservations ['54b35e1c-ecf0-4e1b-afd5-ea98883eb04d', '5b532466-122b-4e7f-8632-0b2597cbd469', '98d9c7b0-ad59-412e-be63-5fa98ae057b2', 'd4b1c755-f4d5-4616-9334-8ae0ee8ea1f4'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Delete snapshot completed successfully. Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2982e97-5f65-4811-b809-0ee8fd3aa07d tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-5ab66c66-85b6-4493-be7a-e510db188ef2-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:38 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2d6e8d94-e625-4355-8043-fd3a726d4f52" returned: 0 in 0.276s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-quobyte-2d6e8d94-e625-4355-8043-fd3a726d4f52" released by "delete_volume" :: held 0.733s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "cinder-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Created reservations ['acb773f6-8f79-4ac9-922f-a6f5d9890cf1', '3feab897-3173-43e0-b87c-daddd911cfa1', 'a360ef60-24da-409f-bb47-164b971c96d9', '728e2361-031d-4d0a-8373-814b51af1234'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "cinder-quobyte-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-quobyte-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff2f1f-1bbf-42b8-a36b-43dbac6fc1dd]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:38 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:38 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:39 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a Sep 08 19:09:39 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:39 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.332s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Deleted volume successfully. Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-61ebd152-d1b6-45f4-babf-b653a9bd373e tempest-VolumesSnapshotListTestJSON-1222538585 None] Lock "cinder-2d6e8d94-e625-4355-8043-fd3a726d4f52-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:39 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" returned: 0 in 0.562s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:39 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a Sep 08 19:09:39 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:39 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" returned: 0 in 0.338s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-quobyte-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a" released by "delete_volume" :: held 0.991s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Created reservations ['b2f824e2-4884-4a7e-a671-fd3075d55cae', 'd6884201-5499-40ac-8c09-c50f269170d8', '4c4c24a5-f423-4cf5-90ba-80596815942d', 'bbe1eca7-87e0-47b2-a86b-d077ea4acc1a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:39 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:39 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:40 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.283s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:40 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Deleted volume successfully. Sep 08 19:09:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f548cb73-c098-4aa7-9e01-197032ed35b4 tempest-SnapshotMetadataTestJSON-841646939 None] Lock "cinder-b8bd74e5-a925-41b7-8d46-f6ad5068ed8a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:46 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:09:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Flow 'volume_create_manager' (6dba037c-0df9-418f-bc33-ceb60da45ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe921f4-718a-48dc-838a-226df6efa000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe921f4-718a-48dc-838a-226df6efa000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1323064912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062af843-aa98-4328-a93d-7cee0eda0110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaa9373e96943e68e9635e3735938ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:47Z,use_quota=True,user_id='9a03963a9590411f93627f6dc1183540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a593d84-8191-4c8e-bd9d-e87f6426eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a593d84-8191-4c8e-bd9d-e87f6426eecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8bb5e9-64e2-4333-9e5a-437122ab2d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8bb5e9-64e2-4333-9e5a-437122ab2d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062af843-aa98-4328-a93d-7cee0eda0110', 'volume_name': 'volume-062af843-aa98-4328-a93d-7cee0eda0110', 'volume_size': 2}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1703de-dfcf-4ce7-af48-51948d4e2dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1703de-dfcf-4ce7-af48-51948d4e2dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d4cf08-fc60-4610-a08e-57ad7af0d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:47 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Volume 062af843-aa98-4328-a93d-7cee0eda0110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062af843-aa98-4328-a93d-7cee0eda0110', 'volume_size': 2} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1323064912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062af843-aa98-4328-a93d-7cee0eda0110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aaa9373e96943e68e9635e3735938ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:47Z,use_quota=True,user_id='9a03963a9590411f93627f6dc1183540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Creating volume 062af843-aa98-4328-a93d-7cee0eda0110 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:09:47 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 2147483648 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:47 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 2147483648 Sep 08 19:09:47 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:47 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 2147483648" returned: 0 in 0.851s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:48 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 Sep 08 19:09:48 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:48 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110" returned: 0 in 0.330s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:09:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d4cf08-fc60-4610-a08e-57ad7af0d999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062af843-aa98-4328-a93d-7cee0eda0110', 'volume_size': 2}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b1cb18-d5d3-4b8b-b72e-0c89f63279c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:48 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Volume volume-062af843-aa98-4328-a93d-7cee0eda0110 (062af843-aa98-4328-a93d-7cee0eda0110): created successfully Sep 08 19:09:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b1cb18-d5d3-4b8b-b72e-0c89f63279c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Flow 'volume_create_manager' (6dba037c-0df9-418f-bc33-ceb60da45ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a4fa0af6-e932-4100-9ac5-c790bd7c9025 tempest-VolumesCloneNegativeTest-407393947 None] Created volume successfully. Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Acquiring lock "cinder-062af843-aa98-4328-a93d-7cee0eda0110-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Lock "cinder-062af843-aa98-4328-a93d-7cee0eda0110-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Acquiring lock "cinder-quobyte-062af843-aa98-4328-a93d-7cee0eda0110" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Lock "cinder-quobyte-062af843-aa98-4328-a93d-7cee0eda0110" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6daa6-7674-4e6b-9010-82b4be414f38]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:49 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 Sep 08 19:09:49 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:49 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:49 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110 Sep 08 19:09:49 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:49 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-062af843-aa98-4328-a93d-7cee0eda0110" returned: 0 in 0.283s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Lock "cinder-quobyte-062af843-aa98-4328-a93d-7cee0eda0110" released by "delete_volume" :: held 0.778s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Created reservations ['ca90bb03-71cf-4524-9b4b-ccf1393b59aa', 'a93cdc81-1cd3-4197-b41d-f0b07e0768a5', '99918f37-9822-4356-b524-b41fa8179cb5', '4f8127f6-e7de-4b07-a5a1-da09344dc441'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:50 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:09:50 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:50 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:50 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Deleted volume successfully. Sep 08 19:09:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1e774239-3b4a-4c48-8218-50ee41740652 tempest-VolumesCloneNegativeTest-407393947 None] Lock "cinder-062af843-aa98-4328-a93d-7cee0eda0110-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:09:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-eec07914-f848-40f3-9daf-3f55564ec757 req-84f6340d-ad2b-4757-a4a5-9807aeec270e tempest-AttachVolumeNegativeTest-1988327816 None] Terminate volume connection completed successfully. Sep 08 19:09:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-eec07914-f848-40f3-9daf-3f55564ec757 req-84f6340d-ad2b-4757-a4a5-9807aeec270e tempest-AttachVolumeNegativeTest-1988327816 None] Deleting attachment d989b76e-dee5-46d6-a9bf-e7b33cdeb0d4. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Flow 'volume_create_manager' (d84a84ea-a307-4b3e-9c87-8671c574be44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7f3b2-50ec-415a-a4c6-3ecb8f1d2f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7f3b2-50ec-415a-a4c6-3ecb8f1d2f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1011519257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256363c7-34d6-4d8a-b391-436b36abf344,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='001f1d0fafa241c684d42bad87b88f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:57Z,use_quota=True,user_id='01e9b40fe78d46348e18e69c8b9ccd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af74e95-a270-49e5-b541-34fc8d1fc45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af74e95-a270-49e5-b541-34fc8d1fc45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cb667d-eaf4-452e-a8c4-05bb2bb15c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cb667d-eaf4-452e-a8c4-05bb2bb15c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256363c7-34d6-4d8a-b391-436b36abf344', 'volume_name': 'volume-256363c7-34d6-4d8a-b391-436b36abf344', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f200ad8-20ec-4734-82cc-78cce39c8ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f200ad8-20ec-4734-82cc-78cce39c8ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3def325b-943c-4fff-b4da-bd4d062f8436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:57 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Volume 256363c7-34d6-4d8a-b391-436b36abf344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256363c7-34d6-4d8a-b391-436b36abf344', 'volume_size': 1} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1011519257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256363c7-34d6-4d8a-b391-436b36abf344,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='001f1d0fafa241c684d42bad87b88f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:09:57Z,use_quota=True,user_id='01e9b40fe78d46348e18e69c8b9ccd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Creating volume 256363c7-34d6-4d8a-b391-436b36abf344 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:09:57 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:09:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:57 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 1073741824 Sep 08 19:09:57 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:58 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 1073741824" returned: 0 in 0.859s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:58 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 Sep 08 19:09:58 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:59 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344" returned: 0 in 0.467s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:09:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:09:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3def325b-943c-4fff-b4da-bd4d062f8436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256363c7-34d6-4d8a-b391-436b36abf344', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f78872d-b3bb-4cb3-bf28-dfb44d263824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:09:59 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Volume volume-256363c7-34d6-4d8a-b391-436b36abf344 (256363c7-34d6-4d8a-b391-436b36abf344): created successfully Sep 08 19:09:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f78872d-b3bb-4cb3-bf28-dfb44d263824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:09:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Flow 'volume_create_manager' (d84a84ea-a307-4b3e-9c87-8671c574be44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:09:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-aa88dd10-5838-4901-874c-10cc3079f19c tempest-VolumesListTestJSON-1497016957 None] Created volume successfully. Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Flow 'volume_create_manager' (5b31040e-36c4-451b-8fdf-44ed75c6658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c355346d-03e4-4f9e-be80-9f3835186090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c355346d-03e4-4f9e-be80-9f3835186090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1066121911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb97488d-e66c-440e-a80f-af929b2a4526,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='001f1d0fafa241c684d42bad87b88f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:00Z,use_quota=True,user_id='01e9b40fe78d46348e18e69c8b9ccd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a282b91-920f-4ef4-9cc6-49ca67ea114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a282b91-920f-4ef4-9cc6-49ca67ea114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab352aa1-c29c-42cc-9dd0-746b6d5ac0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab352aa1-c29c-42cc-9dd0-746b6d5ac0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb97488d-e66c-440e-a80f-af929b2a4526', 'volume_name': 'volume-eb97488d-e66c-440e-a80f-af929b2a4526', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a2fe2-e81d-4e6d-9491-fd88b49f95cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a2fe2-e81d-4e6d-9491-fd88b49f95cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38dba8a4-f012-43ba-b16c-a6df7607ec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:00 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Volume eb97488d-e66c-440e-a80f-af929b2a4526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb97488d-e66c-440e-a80f-af929b2a4526', 'volume_size': 1} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1066121911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb97488d-e66c-440e-a80f-af929b2a4526,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='001f1d0fafa241c684d42bad87b88f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:00Z,use_quota=True,user_id='01e9b40fe78d46348e18e69c8b9ccd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Creating volume eb97488d-e66c-440e-a80f-af929b2a4526 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:00 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:00 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 1073741824 Sep 08 19:10:00 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:01 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 1073741824" returned: 0 in 0.678s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:01 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 Sep 08 19:10:01 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:01 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526" returned: 0 in 0.580s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38dba8a4-f012-43ba-b16c-a6df7607ec8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb97488d-e66c-440e-a80f-af929b2a4526', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caaa637-1221-47e7-9dce-f613aed1791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:01 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Volume volume-eb97488d-e66c-440e-a80f-af929b2a4526 (eb97488d-e66c-440e-a80f-af929b2a4526): created successfully Sep 08 19:10:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4caaa637-1221-47e7-9dce-f613aed1791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Flow 'volume_create_manager' (5b31040e-36c4-451b-8fdf-44ed75c6658a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-efbcd56a-5071-4c66-8535-24c6c42f90e8 tempest-VolumesListTestJSON-1497016957 None] Created volume successfully. Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Flow 'volume_create_manager' (01354a16-dcc7-4d98-b6ce-1d2cb4cb15c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa4814f-db17-4a9a-bce3-94e4130a2c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa4814f-db17-4a9a-bce3-94e4130a2c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-99675632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85c9bc3-4574-4c4f-9b5b-985f2c56865a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='001f1d0fafa241c684d42bad87b88f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:03Z,use_quota=True,user_id='01e9b40fe78d46348e18e69c8b9ccd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726c90b6-17b2-409f-ac87-e7ddce0e79d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726c90b6-17b2-409f-ac87-e7ddce0e79d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed31bec4-615c-4fd5-ac4e-3aa2b827c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed31bec4-615c-4fd5-ac4e-3aa2b827c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85c9bc3-4574-4c4f-9b5b-985f2c56865a', 'volume_name': 'volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d35eb1-0317-47fc-a301-09413d0d4d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d35eb1-0317-47fc-a301-09413d0d4d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5da230-0be0-4d96-af25-8838774679c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:03 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Volume d85c9bc3-4574-4c4f-9b5b-985f2c56865a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a', 'volume_size': 1} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-99675632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85c9bc3-4574-4c4f-9b5b-985f2c56865a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='001f1d0fafa241c684d42bad87b88f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:03Z,use_quota=True,user_id='01e9b40fe78d46348e18e69c8b9ccd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Creating volume d85c9bc3-4574-4c4f-9b5b-985f2c56865a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:03 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:03 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a 1073741824 Sep 08 19:10:03 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:04 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a 1073741824" returned: 0 in 0.570s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:04 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a Sep 08 19:10:04 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:04 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a" returned: 0 in 0.488s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5da230-0be0-4d96-af25-8838774679c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32215fe-67d0-4224-8d89-1c05debbb548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Volume volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a (d85c9bc3-4574-4c4f-9b5b-985f2c56865a): created successfully Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32215fe-67d0-4224-8d89-1c05debbb548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Flow 'volume_create_manager' (01354a16-dcc7-4d98-b6ce-1d2cb4cb15c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-be4d355c-f835-40eb-ae0f-2dee4bd0820f tempest-VolumesListTestJSON-1497016957 None] Created volume successfully. Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "cinder-d85c9bc3-4574-4c4f-9b5b-985f2c56865a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-d85c9bc3-4574-4c4f-9b5b-985f2c56865a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "cinder-quobyte-d85c9bc3-4574-4c4f-9b5b-985f2c56865a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-quobyte-d85c9bc3-4574-4c4f-9b5b-985f2c56865a" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[73923576-13d4-4c86-889a-84989fad700b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:09 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a Sep 08 19:10:09 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:09 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a" returned: 0 in 0.387s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:09 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a Sep 08 19:10:09 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:09 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d85c9bc3-4574-4c4f-9b5b-985f2c56865a" returned: 0 in 0.292s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-quobyte-d85c9bc3-4574-4c4f-9b5b-985f2c56865a" released by "delete_volume" :: held 0.733s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:09 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Created reservations ['a6515030-dbd6-4dd6-8cfe-3482483e3bad', '49afd386-0aac-4692-880c-c1ae8e0c2e13', '93b2f0e5-ddf8-4eaf-af4b-fb682f5e2a76', '9d03fca2-1da6-45cb-828e-bf5f44fe7bc5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:10 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:10:10 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:10 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.341s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:10:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Deleted volume successfully. Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "cinder-eb97488d-e66c-440e-a80f-af929b2a4526-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8ef48b12-7269-4768-8b16-b18773407a33 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-d85c9bc3-4574-4c4f-9b5b-985f2c56865a-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-eb97488d-e66c-440e-a80f-af929b2a4526-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "cinder-quobyte-eb97488d-e66c-440e-a80f-af929b2a4526" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-quobyte-eb97488d-e66c-440e-a80f-af929b2a4526" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[971dcdb5-0c21-4f02-8409-04586e625492]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:10 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 Sep 08 19:10:10 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:11 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526" returned: 0 in 0.473s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:11 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526 Sep 08 19:10:11 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:11 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-eb97488d-e66c-440e-a80f-af929b2a4526" returned: 0 in 0.665s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-quobyte-eb97488d-e66c-440e-a80f-af929b2a4526" released by "delete_volume" :: held 1.241s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:11 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Created reservations ['f3b04bec-ef51-46dc-8bce-9354784b215a', '89821bac-0dbd-404e-b11d-f20bdfd56c2f', '52ea979f-64ee-4692-9741-e9e5c1fdee3d', '40ec6e7e-fc22-42dd-a611-aab16cf5bbff'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:12 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:10:12 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:12 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:10:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Deleted volume successfully. Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85fe6bb3-7594-4408-bece-4898df68bea9 tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-eb97488d-e66c-440e-a80f-af929b2a4526-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "cinder-256363c7-34d6-4d8a-b391-436b36abf344-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-256363c7-34d6-4d8a-b391-436b36abf344-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "cinder-quobyte-256363c7-34d6-4d8a-b391-436b36abf344" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-quobyte-256363c7-34d6-4d8a-b391-436b36abf344" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c98210-289a-4135-9404-ad904d03cc72]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:13 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 Sep 08 19:10:13 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:13 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344" returned: 0 in 0.395s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:13 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344 Sep 08 19:10:13 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:13 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-256363c7-34d6-4d8a-b391-436b36abf344" returned: 0 in 0.296s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-quobyte-256363c7-34d6-4d8a-b391-436b36abf344" released by "delete_volume" :: held 0.742s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Created reservations ['57adbb7f-a799-478d-b00c-e1048c78c6e7', '89d73cd4-99b9-4cc0-a24f-851e7e7bbbd6', '1fc2578d-e861-47f2-88b5-8d36624eccb1', '2ce604a0-15a4-4133-8e79-0dbd286bb19a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:14 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:10:14 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:14 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.488s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:14 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:10:14 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Deleted volume successfully. Sep 08 19:10:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ede98898-cc36-4286-ae3f-fe3963219e6d tempest-VolumesListTestJSON-1497016957 None] Lock "cinder-256363c7-34d6-4d8a-b391-436b36abf344-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Flow 'volume_create_manager' (58af999f-cd92-4c63-9947-53fff652c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd8eecb-5fff-4919-8f0c-cc41fcce881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd8eecb-5fff-4919-8f0c-cc41fcce881e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1078467192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dae06e7-4d9c-4f0f-b3a3-9800630f19fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7adb19a403349c890344b26db9c43f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:21Z,use_quota=True,user_id='72de281f18f445d78bceee93353c68fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c79dfcc-13c9-4cf4-9eb2-b5f92526b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c79dfcc-13c9-4cf4-9eb2-b5f92526b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86cbc3f-4aac-44c1-bd23-50a90d22a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86cbc3f-4aac-44c1-bd23-50a90d22a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dae06e7-4d9c-4f0f-b3a3-9800630f19fd', 'volume_name': 'volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a536eb7c-4794-4618-92ab-38a17e718c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a536eb7c-4794-4618-92ab-38a17e718c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a73298-f40a-4d25-9ce2-d57187b72aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:20 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Volume 9dae06e7-4d9c-4f0f-b3a3-9800630f19fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd', 'volume_size': 1} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1078467192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dae06e7-4d9c-4f0f-b3a3-9800630f19fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7adb19a403349c890344b26db9c43f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:21Z,use_quota=True,user_id='72de281f18f445d78bceee93353c68fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Creating volume 9dae06e7-4d9c-4f0f-b3a3-9800630f19fd {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:20 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:20 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd 1073741824 Sep 08 19:10:21 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:21 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd 1073741824" returned: 0 in 0.701s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:21 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd Sep 08 19:10:21 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:22 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Flow 'volume_create_manager' (ce0582b0-5483-4074-bcd4-de17b24844bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556ee7d1-5e01-404e-9831-1d31c86c79d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd" returned: 0 in 0.383s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556ee7d1-5e01-404e-9831-1d31c86c79d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1165711192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c508d03-a404-4e12-9cc1-3816a04950c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5093beb45f74a1e8961731cce6ec7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:22Z,use_quota=True,user_id='f2859d46160545a3945a1058d4fe5bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976f8046-b5ac-4f89-bc83-99c28e2c14f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976f8046-b5ac-4f89-bc83-99c28e2c14f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ac7a41-ee3f-414b-844e-c7be0b8da4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ac7a41-ee3f-414b-844e-c7be0b8da4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c508d03-a404-4e12-9cc1-3816a04950c1', 'volume_name': 'volume-1c508d03-a404-4e12-9cc1-3816a04950c1', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d92f1fd-637e-437a-84aa-2a32aff4b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d92f1fd-637e-437a-84aa-2a32aff4b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3623e0c4-3d37-4dbc-bc16-0841284e0c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:22 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Volume 1c508d03-a404-4e12-9cc1-3816a04950c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c508d03-a404-4e12-9cc1-3816a04950c1', 'volume_size': 1} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1165711192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c508d03-a404-4e12-9cc1-3816a04950c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5093beb45f74a1e8961731cce6ec7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:22Z,use_quota=True,user_id='f2859d46160545a3945a1058d4fe5bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Creating volume 1c508d03-a404-4e12-9cc1-3816a04950c1 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:22 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a73298-f40a-4d25-9ce2-d57187b72aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d383a6-1ff0-4981-b1d6-4b680955b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:22 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 1073741824 Sep 08 19:10:22 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:22 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Volume volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd (9dae06e7-4d9c-4f0f-b3a3-9800630f19fd): created successfully Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d383a6-1ff0-4981-b1d6-4b680955b93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Flow 'volume_create_manager' (58af999f-cd92-4c63-9947-53fff652c341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ccb504e7-747b-4137-80c6-0b75e60f3aee tempest-VolumesNegativeTest-1143710002 None] Created volume successfully. Sep 08 19:10:22 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 1073741824" returned: 0 in 0.532s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:22 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 Sep 08 19:10:22 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:23 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1" returned: 0 in 0.434s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3623e0c4-3d37-4dbc-bc16-0841284e0c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c508d03-a404-4e12-9cc1-3816a04950c1', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e111d0-7317-4558-bfc6-23f51fc4aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:23 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Volume volume-1c508d03-a404-4e12-9cc1-3816a04950c1 (1c508d03-a404-4e12-9cc1-3816a04950c1): created successfully Sep 08 19:10:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e111d0-7317-4558-bfc6-23f51fc4aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Flow 'volume_create_manager' (ce0582b0-5483-4074-bcd4-de17b24844bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-75aab290-c4bf-41ef-982b-86f4b7f75e9d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Created volume successfully. Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Flow 'volume_create_manager' (9389b8fc-ed95-4ded-9ce9-e864de547a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efe692e-9e0f-44a5-ae36-7c50685f01a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7efe692e-9e0f-44a5-ae36-7c50685f01a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-636072637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612b97d7-5359-4219-b88a-f4c00872d754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335ec6b3ba74a72ba71a1412d8d2380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:24Z,use_quota=True,user_id='2cfde386caf14c8a9d5dfd5c792a870a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cc1b23-c5a7-48a3-91a2-c68af1da9d6b),volume_type_id=13cc1b23-c5a7-48a3-91a2-c68af1da9d6b)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf89e0d4-b849-4bd1-a31b-153fb33447cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf89e0d4-b849-4bd1-a31b-153fb33447cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14991ce4-d1a3-4c98-adfe-934cd3d2bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14991ce4-d1a3-4c98-adfe-934cd3d2bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612b97d7-5359-4219-b88a-f4c00872d754', 'volume_name': 'volume-612b97d7-5359-4219-b88a-f4c00872d754', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44f8891-43b9-42f0-b8c5-d56273ca65a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44f8891-43b9-42f0-b8c5-d56273ca65a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b18e90-b867-4539-9e4a-9310f77186ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:24 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume 612b97d7-5359-4219-b88a-f4c00872d754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612b97d7-5359-4219-b88a-f4c00872d754', 'volume_size': 1} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-636072637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612b97d7-5359-4219-b88a-f4c00872d754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335ec6b3ba74a72ba71a1412d8d2380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:24Z,use_quota=True,user_id='2cfde386caf14c8a9d5dfd5c792a870a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cc1b23-c5a7-48a3-91a2-c68af1da9d6b),volume_type_id=13cc1b23-c5a7-48a3-91a2-c68af1da9d6b)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Creating volume 612b97d7-5359-4219-b88a-f4c00872d754 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:24 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:24 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 1073741824 Sep 08 19:10:24 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Flow 'volume_create_manager' (104ffcd5-a96a-498a-be68-e4d15c4abe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcba9c9d-f583-4e3c-9235-8969c2a22d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcba9c9d-f583-4e3c-9235-8969c2a22d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-217720176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94a19ae-997d-4ac8-b93a-17762af421ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335ec6b3ba74a72ba71a1412d8d2380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:25Z,use_quota=True,user_id='2cfde386caf14c8a9d5dfd5c792a870a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9648f29-d0e9-4e11-8a28-221a0c932e08),volume_type_id=e9648f29-d0e9-4e11-8a28-221a0c932e08)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe8d45f-ba35-4ae5-887c-955311465faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe8d45f-ba35-4ae5-887c-955311465faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de197748-3c75-40d3-83cb-b6db1ca4abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de197748-3c75-40d3-83cb-b6db1ca4abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94a19ae-997d-4ac8-b93a-17762af421ec', 'volume_name': 'volume-f94a19ae-997d-4ac8-b93a-17762af421ec', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7798bbf-3bbd-4d4b-837e-315ab87b578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7798bbf-3bbd-4d4b-837e-315ab87b578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8283e522-1273-494a-97c3-4e18c25c6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:25 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume f94a19ae-997d-4ac8-b93a-17762af421ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94a19ae-997d-4ac8-b93a-17762af421ec', 'volume_size': 1} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:25 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 1073741824" returned: 0 in 1.174s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:25 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 Sep 08 19:10:25 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ba5f38bb-9074-42b2-ad1b-1e76c5754cc3 req-1336da8a-3abb-44db-b5e7-9a795e7f0bde tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:26 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754" returned: 0 in 0.510s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-217720176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94a19ae-997d-4ac8-b93a-17762af421ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335ec6b3ba74a72ba71a1412d8d2380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:25Z,use_quota=True,user_id='2cfde386caf14c8a9d5dfd5c792a870a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9648f29-d0e9-4e11-8a28-221a0c932e08),volume_type_id=e9648f29-d0e9-4e11-8a28-221a0c932e08)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Creating volume f94a19ae-997d-4ac8-b93a-17762af421ec {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:26 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:26 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec 1073741824 Sep 08 19:10:26 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b18e90-b867-4539-9e4a-9310f77186ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612b97d7-5359-4219-b88a-f4c00872d754', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180dba31-796e-4b6c-8f25-be59c55811aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:26 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume volume-612b97d7-5359-4219-b88a-f4c00872d754 (612b97d7-5359-4219-b88a-f4c00872d754): created successfully Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180dba31-796e-4b6c-8f25-be59c55811aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Flow 'volume_create_manager' (9389b8fc-ed95-4ded-9ce9-e864de547a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-75250240-07f8-4169-aec1-ac5c5ed2ee91 tempest-TestInstancesWithCinderVolumes-373601629 None] Created volume successfully. Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Flow 'volume_create_manager' (6d961786-46fd-4948-b0ec-58ccd15df243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d322e2-2111-4106-8f48-7639bc689e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d322e2-2111-4106-8f48-7639bc689e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1958600600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1926e18-395a-4060-a0d5-3f460095cb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335ec6b3ba74a72ba71a1412d8d2380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:27Z,use_quota=True,user_id='2cfde386caf14c8a9d5dfd5c792a870a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b112296-9ac3-4de1-91c5-bb743b25ff37),volume_type_id=8b112296-9ac3-4de1-91c5-bb743b25ff37)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a99f590-b296-4287-862e-cc4634f46616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a99f590-b296-4287-862e-cc4634f46616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc140f4-83ae-4a19-b527-6e3f2ea855fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:26 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:10:27 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec 1073741824" returned: 0 in 1.024s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:27 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec Sep 08 19:10:27 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc140f4-83ae-4a19-b527-6e3f2ea855fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1926e18-395a-4060-a0d5-3f460095cb96', 'volume_name': 'volume-f1926e18-395a-4060-a0d5-3f460095cb96', 'volume_size': 1, 'image_id': '4188b00f-1e8f-4939-8709-55db0d95c3ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4188b00f-1e8f-4939-8709-55db0d95c3ce', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1397348029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a335ec6b3ba74a72ba71a1412d8d2380', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4188b00f-1e8f-4939-8709-55db0d95c3ce', 'created_at': datetime.datetime(2026, 9, 8, 17, 10, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4188b00f-1e8f-4939-8709-55db0d95c3ce/file', 'properties': {}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc0b71e-de2f-47fb-97a7-29a05d62b2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:27 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc0b71e-de2f-47fb-97a7-29a05d62b2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7666c8-d1b9-4bfe-9d7d-3dcf2fd3c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume f1926e18-395a-4060-a0d5-3f460095cb96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1926e18-395a-4060-a0d5-3f460095cb96', 'volume_size': 1, 'image_id': '4188b00f-1e8f-4939-8709-55db0d95c3ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4188b00f-1e8f-4939-8709-55db0d95c3ce', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1397348029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a335ec6b3ba74a72ba71a1412d8d2380', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4188b00f-1e8f-4939-8709-55db0d95c3ce', 'created_at': datetime.datetime(2026, 9, 8, 17, 10, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4188b00f-1e8f-4939-8709-55db0d95c3ce/file', 'properties': {}}, 'image_service': } Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Trying to clone f1926e18-395a-4060-a0d5-3f460095cb96 from image 4188b00f-1e8f-4939-8709-55db0d95c3ce at location (None, [{'url': 'file:///opt/stack/data/glance/images/4188b00f-1e8f-4939-8709-55db0d95c3ce', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec" returned: 0 in 0.445s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ba5f38bb-9074-42b2-ad1b-1e76c5754cc3 req-1336da8a-3abb-44db-b5e7-9a795e7f0bde tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.934s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ba5f38bb-9074-42b2-ad1b-1e76c5754cc3 req-1336da8a-3abb-44db-b5e7-9a795e7f0bde tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8283e522-1273-494a-97c3-4e18c25c6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94a19ae-997d-4ac8-b93a-17762af421ec', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f80276-1d93-429f-a2bb-7a4dbe8f8dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume volume-f94a19ae-997d-4ac8-b93a-17762af421ec (f94a19ae-997d-4ac8-b93a-17762af421ec): created successfully Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f80276-1d93-429f-a2bb-7a4dbe8f8dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Flow 'volume_create_manager' (104ffcd5-a96a-498a-be68-e4d15c4abe08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9183cf15-8704-4885-a91d-bdc8ad65a252 tempest-TestInstancesWithCinderVolumes-373601629 None] Created volume successfully. Sep 08 19:10:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ba5f38bb-9074-42b2-ad1b-1e76c5754cc3 req-1336da8a-3abb-44db-b5e7-9a795e7f0bde tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-1c508d03-a404-4e12-9cc1-3816a04950c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eea1849a-4f07-413e-9f9a-fc516d63766f', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:10:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-ba5f38bb-9074-42b2-ad1b-1e76c5754cc3 req-1336da8a-3abb-44db-b5e7-9a795e7f0bde tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] attachment_update completed successfully. Sep 08 19:10:32 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=85,cinder:UPDATE=85,cinder:INSERT=23,cinder:DELETE=10 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:10:32 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=71,cinder:INSERT=26,cinder:UPDATE=110,cinder:DELETE=5 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:10:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-ab7109e2-9790-4718-8fc0-b9a134bcacd5 req-930fdeeb-0b6f-4db4-a7c7-575da032c44d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Terminate volume connection completed successfully. Sep 08 19:10:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ab7109e2-9790-4718-8fc0-b9a134bcacd5 req-930fdeeb-0b6f-4db4-a7c7-575da032c44d tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Deleting attachment eea1849a-4f07-413e-9f9a-fc516d63766f. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:10:32 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD, size 20.69 MB, duration 5.05 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:10:32 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Image download 20.69 MB at 4.10 MB/s Sep 08 19:10:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2134e608-24a5-4238-81fa-52374715aafb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:33 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD Sep 08 19:10:33 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Acquiring lock "cinder-1c508d03-a404-4e12-9cc1-3816a04950c1-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "cinder-1c508d03-a404-4e12-9cc1-3816a04950c1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Acquiring lock "cinder-quobyte-1c508d03-a404-4e12-9cc1-3816a04950c1" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "cinder-quobyte-1c508d03-a404-4e12-9cc1-3816a04950c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74ea0d9-dd3d-481a-91c7-79b214539266]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:33 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Temporary image 4188b00f-1e8f-4939-8709-55db0d95c3ce is fetched for user 2cfde386caf14c8a9d5dfd5c792a870a. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:10:33 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 Sep 08 19:10:33 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8edf329-98c6-485b-ba5b-c23f262735c2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:33 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD Sep 08 19:10:33 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:33 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1" returned: 0 in 0.663s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:33 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1 Sep 08 19:10:33 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:34 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1958600600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1926e18-395a-4060-a0d5-3f460095cb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a335ec6b3ba74a72ba71a1412d8d2380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:27Z,use_quota=True,user_id='2cfde386caf14c8a9d5dfd5c792a870a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b112296-9ac3-4de1-91c5-bb743b25ff37),volume_type_id=8b112296-9ac3-4de1-91c5-bb743b25ff37)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Creating volume f1926e18-395a-4060-a0d5-3f460095cb96 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:34 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:34 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 1073741824 Sep 08 19:10:34 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:34 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1c508d03-a404-4e12-9cc1-3816a04950c1" returned: 0 in 0.488s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:34 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:10:34 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "cinder-quobyte-1c508d03-a404-4e12-9cc1-3816a04950c1" released by "delete_volume" :: held 1.245s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Created reservations ['21267179-b825-4a81-9d89-a9682622b487', 'd1e2c1b3-6852-4610-ba82-3ad367f19abd', '0589e090-751b-4183-ad98-6a7b3c24197b', '7c365e00-1be8-4d2f-a942-f1b2050c2ada'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:34 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:10:34 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:34 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.613s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:10:34 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.335s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 28 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:10:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Deleted volume successfully. Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6b7dab1a-52f6-42c7-9b58-1c351196de69 tempest-TestServerVolumeAttachScenarioOldVersion-1524212209 None] Lock "cinder-1c508d03-a404-4e12-9cc1-3816a04950c1-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:35 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 1073741824" returned: 0 in 0.956s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:35 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 Sep 08 19:10:35 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:35 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96" returned: 0 in 0.338s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Attempting download of 4188b00f-1e8f-4939-8709-55db0d95c3ce ((None, [{'url': 'file:///opt/stack/data/glance/images/4188b00f-1e8f-4939-8709-55db0d95c3ce', 'metadata': {}}])) to volume f1926e18-395a-4060-a0d5-3f460095cb96. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28e2359-36fd-471a-a982-4666ae949476]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4188b00f-1e8f-4939-8709-55db0d95c3ce_ab430gea {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:35 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4188b00f-1e8f-4939-8709-55db0d95c3ce_ab430gea Sep 08 19:10:35 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:36 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4188b00f-1e8f-4939-8709-55db0d95c3ce_ab430gea" returned: 0 in 0.674s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4188b00f-1e8f-4939-8709-55db0d95c3ce_ab430gea {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:36 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4188b00f-1e8f-4939-8709-55db0d95c3ce_ab430gea Sep 08 19:10:36 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:36 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4188b00f-1e8f-4939-8709-55db0d95c3ce_ab430gea" returned: 1 in 0.503s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4188b00f-1e8f-4939-8709-55db0d95c3ce_ab430gea' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:10:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afd72bc-dedd-4e06-9ef1-8f0555911114]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:36 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD Sep 08 19:10:36 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:37 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:37 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] 4188b00f-1e8f-4939-8709-55db0d95c3ce was qcow2, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:10:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:37 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 Sep 08 19:10:37 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:39 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96" returned: 0 in 2.208s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4188b00f-1e8f-4939-8709-55db0d95c3ce_mn77gjoddevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:10:39 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Converted 112.00 MB image at 50.70 MB/s Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:39 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 1G Sep 08 19:10:39 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:39 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 1G" returned: 0 in 0.416s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Downloaded image 4188b00f-1e8f-4939-8709-55db0d95c3ce ((None, [{'url': 'file:///opt/stack/data/glance/images/4188b00f-1e8f-4939-8709-55db0d95c3ce', 'metadata': {}}])) to volume f1926e18-395a-4060-a0d5-3f460095cb96 successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Temporary image 4188b00f-1e8f-4939-8709-55db0d95c3ce for user 2cfde386caf14c8a9d5dfd5c792a870a is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Marking volume f1926e18-395a-4060-a0d5-3f460095cb96 as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Copying metadata from image 4188b00f-1e8f-4939-8709-55db0d95c3ce to f1926e18-395a-4060-a0d5-3f460095cb96. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Creating volume glance metadata for volume f1926e18-395a-4060-a0d5-3f460095cb96 backed by image 4188b00f-1e8f-4939-8709-55db0d95c3ce with: {'image_id': '4188b00f-1e8f-4939-8709-55db0d95c3ce', 'image_name': 'tempest-scenario-img--1397348029', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7666c8-d1b9-4bfe-9d7d-3dcf2fd3c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1926e18-395a-4060-a0d5-3f460095cb96', 'volume_size': 1, 'image_id': '4188b00f-1e8f-4939-8709-55db0d95c3ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4188b00f-1e8f-4939-8709-55db0d95c3ce', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1397348029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a335ec6b3ba74a72ba71a1412d8d2380', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4188b00f-1e8f-4939-8709-55db0d95c3ce', 'created_at': datetime.datetime(2026, 9, 8, 17, 10, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4188b00f-1e8f-4939-8709-55db0d95c3ce/file', 'properties': {}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe620ec-aca5-4a36-b744-6cc41270ffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:39 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Volume volume-f1926e18-395a-4060-a0d5-3f460095cb96 (f1926e18-395a-4060-a0d5-3f460095cb96): created successfully Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe620ec-aca5-4a36-b744-6cc41270ffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Flow 'volume_create_manager' (6d961786-46fd-4948-b0ec-58ccd15df243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ad92b7d0-7458-4696-9e48-2e6b549e4aa2 tempest-TestInstancesWithCinderVolumes-373601629 None] Created volume successfully. Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Flow 'volume_create_manager' (f8787180-6366-4b15-a23c-bfa62579050a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3dcc029-2dab-4519-815c-4196848f9880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3dcc029-2dab-4519-815c-4196848f9880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1222949765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01dba93-f6ca-4a1b-b8b4-475c2ebf2617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5bba3142f4b47aa7a296d62db0708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:41Z,use_quota=True,user_id='cea4c6ffd88941a2ac2a264115bca8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77647b2a-bcc4-4489-9f34-422cb78ea4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77647b2a-bcc4-4489-9f34-422cb78ea4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a552ab32-c9c7-4a4e-92a5-96a01576787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a552ab32-c9c7-4a4e-92a5-96a01576787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01dba93-f6ca-4a1b-b8b4-475c2ebf2617', 'volume_name': 'volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcde6d80-20e1-41a9-894a-78a8f97c48bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcde6d80-20e1-41a9-894a-78a8f97c48bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe436f9b-ecf0-4dbf-b618-c0e7279e6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Volume a01dba93-f6ca-4a1b-b8b4-475c2ebf2617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617', 'volume_size': 1} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1222949765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01dba93-f6ca-4a1b-b8b4-475c2ebf2617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5bba3142f4b47aa7a296d62db0708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:41Z,use_quota=True,user_id='cea4c6ffd88941a2ac2a264115bca8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Creating volume a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:40 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:40 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 1073741824 Sep 08 19:10:40 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:41 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 1073741824" returned: 0 in 0.581s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:41 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 Sep 08 19:10:41 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:41 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617" returned: 0 in 0.325s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe436f9b-ecf0-4dbf-b618-c0e7279e6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f4a8ae-9527-4bc7-b447-eb87deb87987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:41 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Volume volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 (a01dba93-f6ca-4a1b-b8b4-475c2ebf2617): created successfully Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f4a8ae-9527-4bc7-b447-eb87deb87987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Flow 'volume_create_manager' (f8787180-6366-4b15-a23c-bfa62579050a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bd165f95-486c-46fe-940f-541ff5d65f4d tempest-AttachVolumeNegativeTest-1988327816 None] Created volume successfully. Sep 08 19:10:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-7e0f6083-e742-4e73-86da-9421e1151aa0 req-b80ca1fc-f0e2-4a08-91b6-e095cdc58fb3 tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-7e0f6083-e742-4e73-86da-9421e1151aa0 req-b80ca1fc-f0e2-4a08-91b6-e095cdc58fb3 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-7e0f6083-e742-4e73-86da-9421e1151aa0 req-b80ca1fc-f0e2-4a08-91b6-e095cdc58fb3 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-7e0f6083-e742-4e73-86da-9421e1151aa0 req-b80ca1fc-f0e2-4a08-91b6-e095cdc58fb3 tempest-AttachVolumeNegativeTest-1988327816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a81fa84-c61c-4ea2-9ce2-abf3cf7da46e', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:10:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-7e0f6083-e742-4e73-86da-9421e1151aa0 req-b80ca1fc-f0e2-4a08-91b6-e095cdc58fb3 tempest-AttachVolumeNegativeTest-1988327816 None] attachment_update completed successfully. Sep 08 19:10:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-f1ea71d6-b3dd-4942-a8d5-20292b3b7854 req-fb2fea4e-33a9-4c63-b497-8b180a9040f8 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-f1ea71d6-b3dd-4942-a8d5-20292b3b7854 req-fb2fea4e-33a9-4c63-b497-8b180a9040f8 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-f1ea71d6-b3dd-4942-a8d5-20292b3b7854 req-fb2fea4e-33a9-4c63-b497-8b180a9040f8 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-f1ea71d6-b3dd-4942-a8d5-20292b3b7854 req-fb2fea4e-33a9-4c63-b497-8b180a9040f8 tempest-TestInstancesWithCinderVolumes-373601629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-f1926e18-395a-4060-a0d5-3f460095cb96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46036c8c-dc12-49e8-98f1-42b4dd944a48', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:10:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-f1ea71d6-b3dd-4942-a8d5-20292b3b7854 req-fb2fea4e-33a9-4c63-b497-8b180a9040f8 tempest-TestInstancesWithCinderVolumes-373601629 None] attachment_update completed successfully. Sep 08 19:10:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Acquiring lock "cinder-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Lock "cinder-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Acquiring lock "cinder-quobyte-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:10:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Lock "cinder-quobyte-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:10:46 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd18b51-0ec8-4b1f-b1ae-89a130410783]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:10:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:46 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd Sep 08 19:10:46 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:47 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-da092a91-9de3-405b-b9ac-28a4de2e9a71 req-a933fe1c-5fd4-4438-8188-5d0f97983519 tempest-AttachVolumeNegativeTest-1988327816 None] Terminate volume connection completed successfully. Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-da092a91-9de3-405b-b9ac-28a4de2e9a71 req-a933fe1c-5fd4-4438-8188-5d0f97983519 tempest-AttachVolumeNegativeTest-1988327816 None] Deleting attachment 2a81fa84-c61c-4ea2-9ce2-abf3cf7da46e. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:10:47 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd" returned: 0 in 0.504s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:47 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd Sep 08 19:10:47 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:47 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd" returned: 0 in 0.343s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Lock "cinder-quobyte-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd" released by "delete_volume" :: held 0.905s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Created reservations ['f0064ee3-eb6a-4f5f-af43-3079224dc803', 'c4a314ab-2c9b-406e-9b67-bba400fbad85', 'c04a78e9-f5c6-4695-928f-01e37322444d', 'f2a4f007-d688-4fbb-9348-dccd076d33b7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:47 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:10:47 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:48 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.434s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:48 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:10:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Deleted volume successfully. Sep 08 19:10:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8d22c588-f218-43dd-9b3c-0b81d7af3ef9 tempest-VolumesNegativeTest-1143710002 None] Lock "cinder-9dae06e7-4d9c-4f0f-b3a3-9800630f19fd-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:10:56 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:10:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Flow 'volume_create_manager' (4b5fcf28-94c4-40da-81eb-98b70d282401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce29216-cab4-495a-a883-c01411ca8252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce29216-cab4-495a-a883-c01411ca8252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-813388652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81b7153-6dd4-4b49-b2d6-b4e548b111f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eea6196fd546e1a6ef02a5ac55f1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:57Z,use_quota=True,user_id='2f336157fd6b434e8ee829c563367fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414dde10-2ce4-4ae0-b2dc-047ad6e7fd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414dde10-2ce4-4ae0-b2dc-047ad6e7fd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5aa721-d952-4995-a2ed-60fa9eba2212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5aa721-d952-4995-a2ed-60fa9eba2212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81b7153-6dd4-4b49-b2d6-b4e548b111f8', 'volume_name': 'volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8', 'volume_size': 2}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac727f45-f729-4d15-86b0-23553b4f7e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac727f45-f729-4d15-86b0-23553b4f7e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5143cb48-860a-44b3-96de-38c5775aa0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:57 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Volume d81b7153-6dd4-4b49-b2d6-b4e548b111f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8', 'volume_size': 2} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-813388652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81b7153-6dd4-4b49-b2d6-b4e548b111f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4eea6196fd546e1a6ef02a5ac55f1a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:10:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:10:57Z,use_quota=True,user_id='2f336157fd6b434e8ee829c563367fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Creating volume d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:10:57 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:10:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 2147483648 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:57 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 2147483648 Sep 08 19:10:57 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:58 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 2147483648" returned: 0 in 0.927s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:58 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 Sep 08 19:10:58 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:58 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" returned: 0 in 0.484s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5143cb48-860a-44b3-96de-38c5775aa0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8', 'volume_size': 2}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03919c46-9ce1-4335-9979-1782ff2d4981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:10:58 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Volume volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 (d81b7153-6dd4-4b49-b2d6-b4e548b111f8): created successfully Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03919c46-9ce1-4335-9979-1782ff2d4981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:10:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Flow 'volume_create_manager' (4b5fcf28-94c4-40da-81eb-98b70d282401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:10:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6e59f84a-bad8-4346-b6cc-ec7a7123958c tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Created volume successfully. Sep 08 19:11:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Creating offline snapshot c0de6aa9-91e0-4001-8d52-5754576b5093 of volume d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:11:00 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c4fb9-a921-4005-9fd8-1b60bd2d1b63]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:00 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 Sep 08 19:11:00 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:00 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" returned: 0 in 0.519s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 2G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:01 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 2G Sep 08 19:11:01 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:01 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 2G" returned: 0 in 0.526s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:01 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 Sep 08 19:11:01 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:01 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:01 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 is being set with open permissions: ugo+rw Sep 08 19:11:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:01 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 Sep 08 19:11:01 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:02 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093" returned: 0 in 0.324s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:02 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.info Sep 08 19:11:02 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:02 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.info" returned: 0 in 0.553s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:02 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.info is being set with open permissions: ugo+rw Sep 08 19:11:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:02 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.info Sep 08 19:11:02 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:03 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.info" returned: 0 in 0.444s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:03 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f2864008-69e5-45c5-aca5-2094d38faea4 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Create snapshot completed successfully Sep 08 19:11:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "cinder-c0de6aa9-91e0-4001-8d52-5754576b5093-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-c0de6aa9-91e0-4001-8d52-5754576b5093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "cinder-quobyte-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-quobyte-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "cinder-quobyte-c0de6aa9-91e0-4001-8d52-5754576b5093" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-quobyte-c0de6aa9-91e0-4001-8d52-5754576b5093" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Deleting offline snapshot c0de6aa9-91e0-4001-8d52-5754576b5093 of volume d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] snapshot_file for this snap is: volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d1acc-9b30-4796-b003-f730fece3166]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:04 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 Sep 08 19:11:04 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:04 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093" returned: 0 in 0.680s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d9310f-33ed-4d2e-bc3f-d8f2a21b1ba7]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:05 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 Sep 08 19:11:05 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:05 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" returned: 0 in 0.671s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:05 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 Sep 08 19:11:05 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:06 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093" returned: 0 in 0.563s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:06 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093 Sep 08 19:11:06 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:06 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8.c0de6aa9-91e0-4001-8d52-5754576b5093" returned: 0 in 0.431s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-quobyte-c0de6aa9-91e0-4001-8d52-5754576b5093" released by "_delete_snapshot" :: held 2.557s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-quobyte-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" released by "delete_snapshot" :: held 2.604s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:06 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Created reservations ['bd17ca4a-4274-4957-b293-b7400caa4b0b', '572e833d-5a7e-4ebe-97ef-9bb20b80696b', 'cab0cdff-3fe9-4e11-9f3d-28a89c163201', '68d39b15-7f67-441e-af62-58718937c5cd'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:11:06 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Delete snapshot completed successfully. Sep 08 19:11:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cfa17087-06b5-4927-bbf9-cd6337d7851a tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-c0de6aa9-91e0-4001-8d52-5754576b5093-delete_snapshot" released by "delete_snapshot" :: held 2.877s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "cinder-d81b7153-6dd4-4b49-b2d6-b4e548b111f8-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-d81b7153-6dd4-4b49-b2d6-b4e548b111f8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "cinder-quobyte-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-quobyte-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd37c8-4b5d-4f58-9d09-94b1f473d9f7]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:07 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 Sep 08 19:11:07 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:08 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" returned: 0 in 0.543s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:08 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8 Sep 08 19:11:08 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:08 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-quobyte-d81b7153-6dd4-4b49-b2d6-b4e548b111f8" released by "delete_volume" :: held 0.948s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Created reservations ['f52e398b-bea4-41d8-a32d-ab0afbdbd64c', '0a006801-08e8-4c02-a1d8-449484b56490', '97fe0e57-2109-4640-90c3-7d63e0e3ab4f', '6543067a-db69-4b3e-abab-fec61372c755'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:08 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:11:08 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:09 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.443s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:09 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:11:09 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Deleted volume successfully. Sep 08 19:11:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6f5f5ba0-5448-4713-a9bc-8763744fa680 tempest-VolumesSnapshotNegativeTestJSON-1401579290 None] Lock "cinder-d81b7153-6dd4-4b49-b2d6-b4e548b111f8-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=47,cinder:UPDATE=40,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Flow 'volume_create_manager' (7a9e94f7-36a7-42ee-95c5-324dce1ee15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43958bd-5c82-4de4-b939-5e0e96bab3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43958bd-5c82-4de4-b939-5e0e96bab3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89e0f5e-fd08-467c-b0e0-463ab18727ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7410e77bc7443c82739894569b576a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:19Z,use_quota=True,user_id='44cf99fa2b1c410c8a1878d783f9a4e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a795e742-da76-4c67-9c9e-8238a8a27ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a795e742-da76-4c67-9c9e-8238a8a27ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206acbfe-e46b-452d-b04a-b7852af6a458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:18 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206acbfe-e46b-452d-b04a-b7852af6a458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd89e0f5e-fd08-467c-b0e0-463ab18727ba', 'volume_name': 'volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba', 'volume_size': 1, 'image_id': 'd4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa17377197199d80a1def374ff482844', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc7410e77bc7443c82739894569b576a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e91a25a0e6e01dfb78b962c33f2a8041eb8df714f8457fb3f6b3e9fd89bc439cd380ab19d2bb4dcff84ec6183ce793f8bd7afafb020097d94dd732ed9e410551', 'id': 'd4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'created_at': datetime.datetime(2026, 9, 8, 17, 11, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 11, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f/file', 'properties': {}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f04a01-2c6a-4ce6-941c-d65792bbfb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f04a01-2c6a-4ce6-941c-d65792bbfb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e66976-7b0d-4fa5-be58-084bd8c5b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:19 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Volume d89e0f5e-fd08-467c-b0e0-463ab18727ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba', 'volume_size': 1, 'image_id': 'd4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa17377197199d80a1def374ff482844', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc7410e77bc7443c82739894569b576a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e91a25a0e6e01dfb78b962c33f2a8041eb8df714f8457fb3f6b3e9fd89bc439cd380ab19d2bb4dcff84ec6183ce793f8bd7afafb020097d94dd732ed9e410551', 'id': 'd4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'created_at': datetime.datetime(2026, 9, 8, 17, 11, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 11, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f/file', 'properties': {}}, 'image_service': } Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Trying to clone d89e0f5e-fd08-467c-b0e0-463ab18727ba from image d4ced61e-8235-449e-ada0-dfbcd6a6ff6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:11:19 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a8cf4-6cd5-46b0-9d5c-012fff8ba634]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:20 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD Sep 08 19:11:20 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:20 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:20 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD Sep 08 19:11:20 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:20 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:11:20 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Temporary image d4ced61e-8235-449e-ada0-dfbcd6a6ff6f is fetched for user 44cf99fa2b1c410c8a1878d783f9a4e8. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:11:20 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a089f20b-7825-46d1-8b4f-f2239242aec6]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:21 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD Sep 08 19:11:21 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:21 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD" returned: 0 in 0.678s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:21 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD Sep 08 19:11:21 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:22 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD" returned: 1 in 0.510s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89e0f5e-fd08-467c-b0e0-463ab18727ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7410e77bc7443c82739894569b576a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:19Z,use_quota=True,user_id='44cf99fa2b1c410c8a1878d783f9a4e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Creating volume d89e0f5e-fd08-467c-b0e0-463ab18727ba {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:11:22 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:22 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba 1073741824 Sep 08 19:11:22 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:22 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba 1073741824" returned: 0 in 0.550s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:22 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba Sep 08 19:11:22 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:23 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba" returned: 0 in 0.511s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Attempting download of d4ced61e-8235-449e-ada0-dfbcd6a6ff6f ((None, [{'url': 'file:///opt/stack/data/glance/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'metadata': {}}])) to volume d89e0f5e-fd08-467c-b0e0-463ab18727ba. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919d3ad-c531-4330-b436-3b939371e74c]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_sa0316_0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:23 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_sa0316_0 Sep 08 19:11:23 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:23 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_sa0316_0" returned: 0 in 0.455s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_sa0316_0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:23 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_sa0316_0 Sep 08 19:11:23 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-62b4922f-9b58-4a92-8ca5-0517f79086d5 req-7fb3f93e-583a-4764-828a-bfe3eae35433 tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-62b4922f-9b58-4a92-8ca5-0517f79086d5 req-7fb3f93e-583a-4764-828a-bfe3eae35433 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-62b4922f-9b58-4a92-8ca5-0517f79086d5 req-7fb3f93e-583a-4764-828a-bfe3eae35433 tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-62b4922f-9b58-4a92-8ca5-0517f79086d5 req-7fb3f93e-583a-4764-828a-bfe3eae35433 tempest-TestInstancesWithCinderVolumes-373601629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-612b97d7-5359-4219-b88a-f4c00872d754', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a58ded9-261e-416d-9a32-2a862dce20d6', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:11:24 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_sa0316_0" returned: 1 in 0.582s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_sa0316_0' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d188b6df-acf4-4b01-91d8-97b86d053879]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-62b4922f-9b58-4a92-8ca5-0517f79086d5 req-7fb3f93e-583a-4764-828a-bfe3eae35433 tempest-TestInstancesWithCinderVolumes-373601629 None] attachment_update completed successfully. Sep 08 19:11:24 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD Sep 08 19:11:24 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:24 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:25 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD Sep 08 19:11:25 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:25 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD" returned: 1 in 0.590s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:11:25 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] d4ced61e-8235-449e-ada0-dfbcd6a6ff6f was raw, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:11:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:25 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba Sep 08 19:11:25 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:26 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba" returned: 0 in 0.577s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d4ced61e-8235-449e-ada0-dfbcd6a6ff6f_1ulbr05adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:11:26 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:26 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba 1G Sep 08 19:11:26 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:26 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba 1G" returned: 0 in 0.487s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Downloaded image d4ced61e-8235-449e-ada0-dfbcd6a6ff6f ((None, [{'url': 'file:///opt/stack/data/glance/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'metadata': {}}])) to volume d89e0f5e-fd08-467c-b0e0-463ab18727ba successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Temporary image d4ced61e-8235-449e-ada0-dfbcd6a6ff6f for user 44cf99fa2b1c410c8a1878d783f9a4e8 is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Marking volume d89e0f5e-fd08-467c-b0e0-463ab18727ba as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Copying metadata from image d4ced61e-8235-449e-ada0-dfbcd6a6ff6f to d89e0f5e-fd08-467c-b0e0-463ab18727ba. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Creating volume glance metadata for volume d89e0f5e-fd08-467c-b0e0-463ab18727ba backed by image d4ced61e-8235-449e-ada0-dfbcd6a6ff6f with: {'image_id': 'd4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'aa17377197199d80a1def374ff482844', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e66976-7b0d-4fa5-be58-084bd8c5b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba', 'volume_size': 1, 'image_id': 'd4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa17377197199d80a1def374ff482844', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc7410e77bc7443c82739894569b576a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e91a25a0e6e01dfb78b962c33f2a8041eb8df714f8457fb3f6b3e9fd89bc439cd380ab19d2bb4dcff84ec6183ce793f8bd7afafb020097d94dd732ed9e410551', 'id': 'd4ced61e-8235-449e-ada0-dfbcd6a6ff6f', 'created_at': datetime.datetime(2026, 9, 8, 17, 11, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 11, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4ced61e-8235-449e-ada0-dfbcd6a6ff6f/file', 'properties': {}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bdb835-c8d1-4ab7-a649-b7d8faa7bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:26 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Volume volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba (d89e0f5e-fd08-467c-b0e0-463ab18727ba): created successfully Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bdb835-c8d1-4ab7-a649-b7d8faa7bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Flow 'volume_create_manager' (7a9e94f7-36a7-42ee-95c5-324dce1ee15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:11:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-01ba7b4e-d91d-4e2b-a687-a7cdcaf33073 tempest-VolumeImageDependencyTests-1737197412 None] Created volume successfully. Sep 08 19:11:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Acquiring lock "cinder-d89e0f5e-fd08-467c-b0e0-463ab18727ba-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Lock "cinder-d89e0f5e-fd08-467c-b0e0-463ab18727ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Acquiring lock "cinder-quobyte-d89e0f5e-fd08-467c-b0e0-463ab18727ba" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Lock "cinder-quobyte-d89e0f5e-fd08-467c-b0e0-463ab18727ba" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:27 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[14911272-da5c-4860-924c-22201437857c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:28 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba Sep 08 19:11:28 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-18009b87-798f-491f-a641-b44b7dbd299c req-c6395a86-bebf-4cfd-ae0c-38e41b0d7aba tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-18009b87-798f-491f-a641-b44b7dbd299c req-c6395a86-bebf-4cfd-ae0c-38e41b0d7aba tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-18009b87-798f-491f-a641-b44b7dbd299c req-c6395a86-bebf-4cfd-ae0c-38e41b0d7aba tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-18009b87-798f-491f-a641-b44b7dbd299c req-c6395a86-bebf-4cfd-ae0c-38e41b0d7aba tempest-TestInstancesWithCinderVolumes-373601629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-f94a19ae-997d-4ac8-b93a-17762af421ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bc3d72e-2ad4-4831-9349-979afbefe142', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:11:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-18009b87-798f-491f-a641-b44b7dbd299c req-c6395a86-bebf-4cfd-ae0c-38e41b0d7aba tempest-TestInstancesWithCinderVolumes-373601629 None] attachment_update completed successfully. Sep 08 19:11:28 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba" returned: 0 in 0.577s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:28 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba Sep 08 19:11:28 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:28 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d89e0f5e-fd08-467c-b0e0-463ab18727ba" returned: 0 in 0.429s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:28 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Lock "cinder-quobyte-d89e0f5e-fd08-467c-b0e0-463ab18727ba" released by "delete_volume" :: held 1.119s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Created reservations ['3c4043fc-6599-4bac-861e-f52820d989c5', 'c78c010e-3018-492a-b17c-5a6fc46bff99', '6fcd5e1a-554a-4d8e-becc-29091d210017', '119206d0-3f54-47d8-8237-6352caea46d8'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:29 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:11:29 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:29 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.302s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:11:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Deleted volume successfully. Sep 08 19:11:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83f01c10-9929-419e-8692-0c648cffac67 tempest-VolumeImageDependencyTests-1737197412 None] Lock "cinder-d89e0f5e-fd08-467c-b0e0-463ab18727ba-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Flow 'volume_create_manager' (432c494f-5295-4654-b6b2-de674f813e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf6400f-04ea-4121-85ae-4634b63a85a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf6400f-04ea-4121-85ae-4634b63a85a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1463359835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b492e96-21b3-4310-ae3c-733036edab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a7df4df85a4c3d975f102da2eeef3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:30Z,use_quota=True,user_id='454eed2047aa4c6297a16594aada5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71f8722-1e28-4a4d-a2b2-021c4d424286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f71f8722-1e28-4a4d-a2b2-021c4d424286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92fb3b5-1744-4137-b45b-9bab0146cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f92fb3b5-1744-4137-b45b-9bab0146cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b492e96-21b3-4310-ae3c-733036edab3e', 'volume_name': 'volume-8b492e96-21b3-4310-ae3c-733036edab3e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac7c9a-7495-4ff8-bd81-7ee08a816c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac7c9a-7495-4ff8-bd81-7ee08a816c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38b9369-021c-4580-aaf4-c0ed0a282abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:30 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Volume 8b492e96-21b3-4310-ae3c-733036edab3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b492e96-21b3-4310-ae3c-733036edab3e', 'volume_size': 1} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1463359835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b492e96-21b3-4310-ae3c-733036edab3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a7df4df85a4c3d975f102da2eeef3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:30Z,use_quota=True,user_id='454eed2047aa4c6297a16594aada5ffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Creating volume 8b492e96-21b3-4310-ae3c-733036edab3e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:11:30 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:30 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e 1073741824 Sep 08 19:11:30 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:30 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e 1073741824" returned: 0 in 0.507s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:30 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e Sep 08 19:11:30 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:31 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:11:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38b9369-021c-4580-aaf4-c0ed0a282abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b492e96-21b3-4310-ae3c-733036edab3e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4022e902-8058-4142-840d-103490945335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Volume volume-8b492e96-21b3-4310-ae3c-733036edab3e (8b492e96-21b3-4310-ae3c-733036edab3e): created successfully Sep 08 19:11:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4022e902-8058-4142-840d-103490945335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Flow 'volume_create_manager' (432c494f-5295-4654-b6b2-de674f813e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:11:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-dac1a4fa-636f-456d-be39-7ca0f2937d58 tempest-TestImageHashVerification-242717086 None] Created volume successfully. Sep 08 19:11:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39fbeeb-a6be-44d1-88d7-c47967985b98]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:33 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e Sep 08 19:11:33 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:33 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e" returned: 0 in 0.413s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:33 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49ece6a-f4cc-4934-91f7-b68ead8de17f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=80,cinder:INSERT=19,cinder:UPDATE=66,cinder:DELETE=8 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:11:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-60c9d6ee-a907-4c5e-9f64-d24571b69f7a req-1076f0f4-4e1a-40bd-9a29-a02225345b90 tempest-TestInstancesWithCinderVolumes-373601629 None] Terminate volume connection completed successfully. Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-60c9d6ee-a907-4c5e-9f64-d24571b69f7a req-1076f0f4-4e1a-40bd-9a29-a02225345b90 tempest-TestInstancesWithCinderVolumes-373601629 None] Deleting attachment 1a58ded9-261e-416d-9a32-2a862dce20d6. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:11:34 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e Sep 08 19:11:34 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Flow 'volume_create_manager' (067b9417-0606-4086-b2d9-3c637a49ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e02edc-e89f-45ed-8097-622d6553c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e02edc-e89f-45ed-8097-622d6553c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93133168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0de9b-bfae-4445-b784-cd36b9e4a392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd9b677cafc4e93a3f90e9922d2ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:34Z,use_quota=True,user_id='f4fb66166d2b41b1851a3ed93da34472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f50a79-58f0-4e65-86c5-82cc02cae734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:34 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f50a79-58f0-4e65-86c5-82cc02cae734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90198e6-2d5b-47c9-9e1b-ce6deb8230fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90198e6-2d5b-47c9-9e1b-ce6deb8230fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8f0de9b-bfae-4445-b784-cd36b9e4a392', 'volume_name': 'volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d964615-9729-4fc1-9ae4-494b82cbc745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d964615-9729-4fc1-9ae4-494b82cbc745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c9840-1d2f-4eb0-b91e-6f156f9a1594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Volume a8f0de9b-bfae-4445-b784-cd36b9e4a392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392', 'volume_size': 1} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e" returned: 0 in 0.489s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e /opt/stack/data/cinder/conversion/8b492e96-21b3-4310-ae3c-733036edab3e.temp_image.b04d1390-ec72-45ac-adfc-2c43378ac361llx9kl_t.img {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:34 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e /opt/stack/data/cinder/conversion/8b492e96-21b3-4310-ae3c-733036edab3e.temp_image.b04d1390-ec72-45ac-adfc-2c43378ac361llx9kl_t.img Sep 08 19:11:34 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "cinder-612b97d7-5359-4219-b88a-f4c00872d754-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-612b97d7-5359-4219-b88a-f4c00872d754-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "cinder-quobyte-612b97d7-5359-4219-b88a-f4c00872d754" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-quobyte-612b97d7-5359-4219-b88a-f4c00872d754" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f9ed5-e47e-420d-814f-73a67badbf13]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:35 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 Sep 08 19:11:35 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:35 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754" returned: 0 in 0.626s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:35 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754 Sep 08 19:11:35 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:36 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-612b97d7-5359-4219-b88a-f4c00872d754" returned: 0 in 0.595s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-quobyte-612b97d7-5359-4219-b88a-f4c00872d754" released by "delete_volume" :: held 1.329s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:36 devstack cinder-volume[87538]: WARNING cinder.quota [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1448649177-1411797546 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1448649177-1411797546, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:11:36 devstack cinder-volume[87538]: WARNING cinder.quota [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1448649177-1411797546 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1448649177-1411797546, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Created reservations ['2738468b-15ba-4106-837f-5a94302be3db', '77b1a070-2b2a-4c9d-a249-836bd80770ea', '8d680a13-5f57-4bc0-98f1-3e2cf75afdb7', '7ebb85f7-d4fa-4626-9fd7-1def54deff1b'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:36 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:11:36 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:37 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.760s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:37 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:11:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Deleted volume successfully. Sep 08 19:11:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1347534f-c2f1-41bb-b15e-14e0dd08140d tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-612b97d7-5359-4219-b88a-f4c00872d754-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:40 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e /opt/stack/data/cinder/conversion/8b492e96-21b3-4310-ae3c-733036edab3e.temp_image.b04d1390-ec72-45ac-adfc-2c43378ac361llx9kl_t.img" returned: 0 in 5.832s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:40 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a6da2-673c-4a7e-8f6a-1521eeabbeef]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:40 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e Sep 08 19:11:40 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-b8eec1b8-1335-4776-8423-eda0ce83941f req-a7674d39-158a-4a8e-9079-98705558f07a tempest-TestInstancesWithCinderVolumes-373601629 None] Terminate volume connection completed successfully. Sep 08 19:11:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-b8eec1b8-1335-4776-8423-eda0ce83941f req-a7674d39-158a-4a8e-9079-98705558f07a tempest-TestInstancesWithCinderVolumes-373601629 None] Deleting attachment 5bc3d72e-2ad4-4831-9349-979afbefe142. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:11:40 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e" returned: 0 in 0.563s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:40 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/conversion/8b492e96-21b3-4310-ae3c-733036edab3e.temp_image.b04d1390-ec72-45ac-adfc-2c43378ac361llx9kl_t.img {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:11:40 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Converted 1024.00 MB image at 175.56 MB/s Sep 08 19:11:40 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] b04d1390-ec72-45ac-adfc-2c43378ac361 was raw, no need to convert to raw {{(pid=87538) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "cinder-f94a19ae-997d-4ac8-b93a-17762af421ec-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-f94a19ae-997d-4ac8-b93a-17762af421ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "cinder-quobyte-f94a19ae-997d-4ac8-b93a-17762af421ec" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-quobyte-f94a19ae-997d-4ac8-b93a-17762af421ec" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7170563-f847-4d8b-90ee-3642a922db4f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Flow 'volume_create_manager' (09ae5101-035c-4613-8bfe-44482a206d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3303aa9-66d4-46c6-bdea-4a8ace26061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3303aa9-66d4-46c6-bdea-4a8ace26061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2102759167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c4964-a920-4c6b-af23-0e5464299be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5bba3142f4b47aa7a296d62db0708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:42Z,use_quota=True,user_id='cea4c6ffd88941a2ac2a264115bca8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89efc340-4ef6-4a68-ab8c-a182c586233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89efc340-4ef6-4a68-ab8c-a182c586233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98819ef8-3c6e-4b80-89b8-c7518fc31254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98819ef8-3c6e-4b80-89b8-c7518fc31254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356c4964-a920-4c6b-af23-0e5464299be6', 'volume_name': 'volume-356c4964-a920-4c6b-af23-0e5464299be6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ed9783-5675-4812-9ada-b2fb0468ef60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ed9783-5675-4812-9ada-b2fb0468ef60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff81ffa-e788-4b5d-9f83-70fbdb00c63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:11:41 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Volume 356c4964-a920-4c6b-af23-0e5464299be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356c4964-a920-4c6b-af23-0e5464299be6', 'volume_size': 1} Sep 08 19:11:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:41 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec Sep 08 19:11:41 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:42 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec" returned: 0 in 0.433s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:42 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec Sep 08 19:11:42 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:42 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f94a19ae-997d-4ac8-b93a-17762af421ec" returned: 0 in 0.281s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-quobyte-f94a19ae-997d-4ac8-b93a-17762af421ec" released by "delete_volume" :: held 0.769s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:42 devstack cinder-volume[87538]: WARNING cinder.quota [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1109619820-1970192700 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1109619820-1970192700, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:11:42 devstack cinder-volume[87538]: WARNING cinder.quota [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1109619820-1970192700 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1109619820-1970192700, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Created reservations ['028a0836-2a53-4202-871a-c299a85ef459', '2c0345eb-837d-4a94-8d4b-f7032f754dbe', '341b6d65-f335-454b-bfb1-fa54a9adf834', '03ca3456-9085-4090-bda8-d8edf039ef3f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:42 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:11:42 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:42 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.325s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:11:42 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Deleted volume successfully. Sep 08 19:11:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20045281-06d1-41aa-9055-1d52e087b67c tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-f94a19ae-997d-4ac8-b93a-17762af421ec-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-cbd4904f-19af-441a-9e11-458f08dcd59c req-fd6cd0f0-98cf-44c8-9bc3-75dfa103240a tempest-TestInstancesWithCinderVolumes-373601629 None] Terminate volume connection completed successfully. Sep 08 19:11:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-cbd4904f-19af-441a-9e11-458f08dcd59c req-fd6cd0f0-98cf-44c8-9bc3-75dfa103240a tempest-TestInstancesWithCinderVolumes-373601629 None] Deleting attachment 46036c8c-dc12-49e8-98f1-42b4dd944a48. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "cinder-f1926e18-395a-4060-a0d5-3f460095cb96-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-f1926e18-395a-4060-a0d5-3f460095cb96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "cinder-quobyte-f1926e18-395a-4060-a0d5-3f460095cb96" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-quobyte-f1926e18-395a-4060-a0d5-3f460095cb96" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c651496-0d1c-4762-ac8b-92c316942b35]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:47 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 Sep 08 19:11:47 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:47 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96" returned: 0 in 0.396s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:47 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96 Sep 08 19:11:47 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:47 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f1926e18-395a-4060-a0d5-3f460095cb96" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-quobyte-f1926e18-395a-4060-a0d5-3f460095cb96" released by "delete_volume" :: held 0.714s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:47 devstack cinder-volume[87538]: WARNING cinder.quota [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1137828272-1234613179 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1137828272-1234613179, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:11:47 devstack cinder-volume[87538]: WARNING cinder.quota [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1137828272-1234613179 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1137828272-1234613179, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Created reservations ['f6e9f99e-88c5-43d0-bfce-2496e2137618', 'de54ebe3-6766-4c82-9966-de4342036399', '20d66a0e-9001-40c5-b632-abb1769a5234', 'bfaa6687-ddf6-462a-aad9-d3ff77f727c9'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:11:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:11:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:11:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:11:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:11:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:48 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:11:48 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:48 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.285s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:48 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:11:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Deleted volume successfully. Sep 08 19:11:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c1ede038-04f0-44d3-b1ed-7be65f12d37f tempest-TestInstancesWithCinderVolumes-373601629 None] Lock "cinder-f1926e18-395a-4060-a0d5-3f460095cb96-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:11:57 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=45,cinder:INSERT=13,cinder:UPDATE=43,cinder:DELETE=2 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:11:58 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.376s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Uploaded volume to glance image-id: b04d1390-ec72-45ac-adfc-2c43378ac361. {{(pid=87538) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.438s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-93133168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8f0de9b-bfae-4445-b784-cd36b9e4a392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd9b677cafc4e93a3f90e9922d2ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:34Z,use_quota=True,user_id='f4fb66166d2b41b1851a3ed93da34472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Creating volume a8f0de9b-bfae-4445-b784-cd36b9e4a392 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:02 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:02 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 1073741824 Sep 08 19:12:02 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-727199bf-4ef9-40b8-92df-765f272f3378 tempest-TestImageHashVerification-242717086 None] Copy volume to image completed successfully. Sep 08 19:12:03 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 1073741824" returned: 0 in 0.469s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:03 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 Sep 08 19:12:03 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Acquiring lock "cinder-8b492e96-21b3-4310-ae3c-733036edab3e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Lock "cinder-8b492e96-21b3-4310-ae3c-733036edab3e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:03 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392" returned: 0 in 0.321s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.988s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2102759167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c4964-a920-4c6b-af23-0e5464299be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd5bba3142f4b47aa7a296d62db0708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:11:42Z,use_quota=True,user_id='cea4c6ffd88941a2ac2a264115bca8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Creating volume 356c4964-a920-4c6b-af23-0e5464299be6 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:03 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:03 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 1073741824 Sep 08 19:12:03 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89c9840-1d2f-4eb0-b91e-6f156f9a1594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275d59a-7596-461b-b84f-a119cda7b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Acquiring lock "cinder-quobyte-8b492e96-21b3-4310-ae3c-733036edab3e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Lock "cinder-quobyte-8b492e96-21b3-4310-ae3c-733036edab3e" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:03 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Volume volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 (a8f0de9b-bfae-4445-b784-cd36b9e4a392): created successfully Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275d59a-7596-461b-b84f-a119cda7b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Flow 'volume_create_manager' (067b9417-0606-4086-b2d9-3c637a49ee92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ca51a0-fc45-4bd2-ba5a-d432b99e0d41]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:03 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f3c1b9a8-cccf-44cf-a45b-625242c7483a tempest-ProjectReaderTests-1324596911 None] Created volume successfully. Sep 08 19:12:04 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e Sep 08 19:12:04 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Acquiring lock "cinder-a8f0de9b-bfae-4445-b784-cd36b9e4a392-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Lock "cinder-a8f0de9b-bfae-4445-b784-cd36b9e4a392-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:04 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e" returned: 0 in 0.515s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:04 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e Sep 08 19:12:04 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Acquiring lock "cinder-quobyte-a8f0de9b-bfae-4445-b784-cd36b9e4a392" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:04 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 1073741824" returned: 0 in 0.716s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Lock "cinder-quobyte-a8f0de9b-bfae-4445-b784-cd36b9e4a392" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c133a4-a138-4682-8e43-be02fd0d988b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:04 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 Sep 08 19:12:04 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:04 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 Sep 08 19:12:04 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:04 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-8b492e96-21b3-4310-ae3c-733036edab3e" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Lock "cinder-quobyte-8b492e96-21b3-4310-ae3c-733036edab3e" released by "delete_volume" :: held 0.885s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Created reservations ['f5214383-d0d3-4f63-a569-22ade3c0f701', '0f058ab4-d073-441f-984f-e058f0af3545', '52e449d8-1e30-4c66-b5aa-7497d36ca9b1', '7cecfa9b-2eaf-40c7-ac52-496b4b10f159'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:04 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6" returned: 0 in 0.337s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff81ffa-e788-4b5d-9f83-70fbdb00c63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356c4964-a920-4c6b-af23-0e5464299be6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed2522c-edfa-44ba-ad9c-06d2b001fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:04 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Volume volume-356c4964-a920-4c6b-af23-0e5464299be6 (356c4964-a920-4c6b-af23-0e5464299be6): created successfully Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed2522c-edfa-44ba-ad9c-06d2b001fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Flow 'volume_create_manager' (09ae5101-035c-4613-8bfe-44482a206d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:04 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:04 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392" returned: 0 in 0.459s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4fbed0d1-a69a-4dc4-867f-3529cd570f9e tempest-AttachVolumeNegativeTest-1988327816 None] Created volume successfully. Sep 08 19:12:04 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392 Sep 08 19:12:04 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:05 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Deleted volume successfully. Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a5cec41a-8b0c-444d-9b3f-1668e53ac8c2 tempest-TestImageHashVerification-242717086 None] Lock "cinder-8b492e96-21b3-4310-ae3c-733036edab3e-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:05 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a8f0de9b-bfae-4445-b784-cd36b9e4a392" returned: 0 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Lock "cinder-quobyte-a8f0de9b-bfae-4445-b784-cd36b9e4a392" released by "delete_volume" :: held 0.840s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Created reservations ['6178abab-004d-40cf-8c1b-996d58edefa8', '7d252d41-d56c-46c0-b342-121b92a3786c', 'c7ce19eb-c5f0-482b-a690-912e3ea4a716', '28013525-5dc3-476e-a54a-3b04b2d5be03'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:05 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:05 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:05 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Deleted volume successfully. Sep 08 19:12:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-670318b2-f043-4a5e-a234-7cdf47956d3f tempest-ProjectReaderTests-1324596911 None] Lock "cinder-a8f0de9b-bfae-4445-b784-cd36b9e4a392-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Flow 'volume_create_manager' (b3851dd7-9a3a-45d5-99c7-3a1c1e120eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdce8ee-997f-47c4-96c7-487b9f7b3e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdce8ee-997f-47c4-96c7-487b9f7b3e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553787051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ea1b9b-67f5-4979-9dc2-299a3ec84bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd9b677cafc4e93a3f90e9922d2ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:06Z,use_quota=True,user_id='f4fb66166d2b41b1851a3ed93da34472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0caa2a-27bb-4d94-9c28-544ef6b1da86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0caa2a-27bb-4d94-9c28-544ef6b1da86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe87bb-aca5-4944-b6c2-8a5bbb642e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfe87bb-aca5-4944-b6c2-8a5bbb642e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ea1b9b-67f5-4979-9dc2-299a3ec84bbd', 'volume_name': 'volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee1af38-77e2-4dc8-9a00-ef4751fa7021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee1af38-77e2-4dc8-9a00-ef4751fa7021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aed630-452a-4566-895d-4d3d3265f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:06 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Volume 14ea1b9b-67f5-4979-9dc2-299a3ec84bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd', 'volume_size': 1} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553787051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ea1b9b-67f5-4979-9dc2-299a3ec84bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edd9b677cafc4e93a3f90e9922d2ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:06Z,use_quota=True,user_id='f4fb66166d2b41b1851a3ed93da34472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Creating volume 14ea1b9b-67f5-4979-9dc2-299a3ec84bbd {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:06 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:06 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd 1073741824 Sep 08 19:12:06 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-b6c81339-76a8-4f21-a588-29d9df97ce7b req-a3c1d6de-ecd1-49b6-9a70-d527ebb68dad tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:06 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd 1073741824" returned: 0 in 0.572s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:06 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd Sep 08 19:12:06 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:07 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-b6c81339-76a8-4f21-a588-29d9df97ce7b req-a3c1d6de-ecd1-49b6-9a70-d527ebb68dad tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.851s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-b6c81339-76a8-4f21-a588-29d9df97ce7b req-a3c1d6de-ecd1-49b6-9a70-d527ebb68dad tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0aed630-452a-4566-895d-4d3d3265f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5f8dc3-bd63-4649-9336-f8c6dabc0194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:07 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Volume volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd (14ea1b9b-67f5-4979-9dc2-299a3ec84bbd): created successfully Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5f8dc3-bd63-4649-9336-f8c6dabc0194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Flow 'volume_create_manager' (b3851dd7-9a3a-45d5-99c7-3a1c1e120eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-b6c81339-76a8-4f21-a588-29d9df97ce7b req-a3c1d6de-ecd1-49b6-9a70-d527ebb68dad tempest-AttachVolumeNegativeTest-1988327816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-356c4964-a920-4c6b-af23-0e5464299be6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d53e5c6-0130-418d-90f9-63ff3c5eacc1', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:12:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-106b9b80-ff2a-404d-ae7f-0bfb8c67f48f tempest-ProjectReaderTests-1324596911 None] Created volume successfully. Sep 08 19:12:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-b6c81339-76a8-4f21-a588-29d9df97ce7b req-a3c1d6de-ecd1-49b6-9a70-d527ebb68dad tempest-AttachVolumeNegativeTest-1988327816 None] attachment_update completed successfully. Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Acquiring lock "cinder-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Lock "cinder-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Acquiring lock "cinder-quobyte-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Lock "cinder-quobyte-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a161773-3c92-4add-a451-edccc23f0c03]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:08 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd Sep 08 19:12:08 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:08 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd" returned: 0 in 0.421s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:08 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd Sep 08 19:12:08 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:09 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd" returned: 0 in 0.302s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Lock "cinder-quobyte-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd" released by "delete_volume" :: held 0.771s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Created reservations ['3867e59b-5e26-422b-816c-3348adedd18c', '1482df40-33e3-4c4d-9194-605bd814e840', 'eb1ef073-357e-4976-9c8c-aaa48cb73c48', '55f73011-3a7a-4342-98cd-5cd9ef58d7f7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:09 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:09 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:09 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.436s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:09 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Deleted volume successfully. Sep 08 19:12:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5feca9ca-542e-427a-be9c-3423ae361bb8 tempest-ProjectReaderTests-1324596911 None] Lock "cinder-14ea1b9b-67f5-4979-9dc2-299a3ec84bbd-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-ff84375a-a637-4584-b60f-c9db39330795 req-35681fbc-f362-4fc3-b685-adeb00e41ba2 tempest-AttachVolumeNegativeTest-1988327816 None] Terminate volume connection completed successfully. Sep 08 19:12:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ff84375a-a637-4584-b60f-c9db39330795 req-35681fbc-f362-4fc3-b685-adeb00e41ba2 tempest-AttachVolumeNegativeTest-1988327816 None] Deleting attachment 9d53e5c6-0130-418d-90f9-63ff3c5eacc1. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:12:20 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=28,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:12:20 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=36,cinder:INSERT=9,cinder:SELECT=26,cinder:DELETE=2 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:12:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "cinder-356c4964-a920-4c6b-af23-0e5464299be6-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-356c4964-a920-4c6b-af23-0e5464299be6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "cinder-quobyte-356c4964-a920-4c6b-af23-0e5464299be6" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-quobyte-356c4964-a920-4c6b-af23-0e5464299be6" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c3f0c-0827-456b-b2d6-5149d9fe69f0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:22 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 Sep 08 19:12:22 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:22 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6" returned: 0 in 0.569s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:22 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6 Sep 08 19:12:22 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:22 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-356c4964-a920-4c6b-af23-0e5464299be6" returned: 0 in 0.437s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-quobyte-356c4964-a920-4c6b-af23-0e5464299be6" released by "delete_volume" :: held 1.078s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Created reservations ['3ab9613e-d6fb-4c25-8bed-c1905e572bb5', '6673dfce-933e-41a6-a1aa-26699d3b1a1d', 'cadfe041-0425-4575-9e43-7dacc092eb3b', '1a4a7ca4-24c3-4316-a7f9-86b2f95993b3'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:23 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:23 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:23 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.290s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Deleted volume successfully. Sep 08 19:12:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-56615cce-f22d-4115-9902-80d79aad2f2f tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-356c4964-a920-4c6b-af23-0e5464299be6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "cinder-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "cinder-quobyte-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-quobyte-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12fc8cb-28de-4b7b-a488-474ccfb54e96]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:24 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 Sep 08 19:12:24 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:24 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617" returned: 0 in 0.417s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:24 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617 Sep 08 19:12:24 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:25 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617" returned: 0 in 0.301s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-quobyte-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617" released by "delete_volume" :: held 0.765s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Created reservations ['a2a040dc-63e1-45b4-be3f-ec298d3ab17a', 'db03b56b-7ee7-43fc-8651-cc28c9dc0579', 'b7a81378-4b5e-4f0d-be27-3ba1e53f1e23', 'f6997d0a-32a7-4e54-8069-3a5425b852c5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:25 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:25 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:25 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.343s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Deleted volume successfully. Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d6220ff6-2c38-4306-8e9b-912e1371b4cb tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-a01dba93-f6ca-4a1b-b8b4-475c2ebf2617-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "cinder-188b339e-4d42-4c94-9955-78cf801cacec-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-188b339e-4d42-4c94-9955-78cf801cacec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "cinder-quobyte-188b339e-4d42-4c94-9955-78cf801cacec" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-quobyte-188b339e-4d42-4c94-9955-78cf801cacec" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e312919-4d35-42ed-b298-5f515fc77a68]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:25 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec Sep 08 19:12:25 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:26 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec" returned: 0 in 0.428s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:26 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec Sep 08 19:12:26 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:26 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-188b339e-4d42-4c94-9955-78cf801cacec" returned: 0 in 0.263s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-quobyte-188b339e-4d42-4c94-9955-78cf801cacec" released by "delete_volume" :: held 0.746s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Created reservations ['1eeaf4c8-ddcb-40c6-837f-5ef78704135b', '5fb18ef3-4b4d-4c7c-ba39-e6291019bbee', '6b4636b3-7a71-4bfd-bd0e-fe31fc6cbf64', 'b9ddcf7e-aa2d-4b80-8619-8c18609cd0ce'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:26 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:26 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:27 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.406s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:27 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Deleted volume successfully. Sep 08 19:12:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-35d41b5f-75d8-4eb5-891e-582e14aee496 tempest-AttachVolumeNegativeTest-1988327816 None] Lock "cinder-188b339e-4d42-4c94-9955-78cf801cacec-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Flow 'volume_create_manager' (9d5ba5d3-db40-4a6d-b5a5-83f9e3e100fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582bbe32-0d6f-467a-bf40-de1da266ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582bbe32-0d6f-467a-bf40-de1da266ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-52648889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d7a81b5a6b479a861d69bbd2132197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:30Z,use_quota=True,user_id='1694185d92ed48ec92742bd1be4768e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837da164-75d0-4adf-a79e-731694bff9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837da164-75d0-4adf-a79e-731694bff9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde5ab70-0722-49c5-90ce-226f31eacb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde5ab70-0722-49c5-90ce-226f31eacb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d12e47-c0c8-47c3-9e2c-42b2fcafe64f', 'volume_name': 'volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c962e2-97bb-4c09-9d2b-39bbec8a0bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c962e2-97bb-4c09-9d2b-39bbec8a0bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e0e70e-5207-4396-ae43-bf1dfd52e069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:29 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Volume d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f', 'volume_size': 1} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-52648889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d7a81b5a6b479a861d69bbd2132197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:30Z,use_quota=True,user_id='1694185d92ed48ec92742bd1be4768e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Creating volume d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:29 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:29 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f 1073741824 Sep 08 19:12:29 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Flow 'volume_create_manager' (3374d349-2fc7-4706-963a-5606ee942aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a829ebc-a048-454f-b213-637bd84e1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a829ebc-a048-454f-b213-637bd84e1671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-255697721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083aeedc-98b9-48eb-a5d3-86a48fc74912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d7a81b5a6b479a861d69bbd2132197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:30Z,use_quota=True,user_id='1694185d92ed48ec92742bd1be4768e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d281fea-7535-4ba1-8014-a5187546f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d281fea-7535-4ba1-8014-a5187546f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984963e7-c584-4541-8160-22ab515230a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984963e7-c584-4541-8160-22ab515230a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083aeedc-98b9-48eb-a5d3-86a48fc74912', 'volume_name': 'volume-083aeedc-98b9-48eb-a5d3-86a48fc74912', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9912c3-8ba6-49f1-8e69-41c075a70624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9912c3-8ba6-49f1-8e69-41c075a70624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44048e95-8173-4af3-8af7-a6a3ad391853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:30 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Volume 083aeedc-98b9-48eb-a5d3-86a48fc74912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083aeedc-98b9-48eb-a5d3-86a48fc74912', 'volume_size': 1} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:30 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f 1073741824" returned: 0 in 0.682s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:30 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f Sep 08 19:12:30 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:30 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f" returned: 0 in 0.308s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-255697721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083aeedc-98b9-48eb-a5d3-86a48fc74912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d7a81b5a6b479a861d69bbd2132197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:30Z,use_quota=True,user_id='1694185d92ed48ec92742bd1be4768e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Creating volume 083aeedc-98b9-48eb-a5d3-86a48fc74912 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:30 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e0e70e-5207-4396-ae43-bf1dfd52e069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:30 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 1073741824 Sep 08 19:12:30 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b43cd51-3958-4f1d-8b1a-532848243922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:30 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Volume volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f (d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f): created successfully Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b43cd51-3958-4f1d-8b1a-532848243922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Flow 'volume_create_manager' (9d5ba5d3-db40-4a6d-b5a5-83f9e3e100fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:30 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0ed3748c-5258-4b33-ae0a-bcdd6992335e tempest-TestServerVolumeAttachmentScenario-165747812 None] Created volume successfully. Sep 08 19:12:31 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 1073741824" returned: 0 in 0.601s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:31 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 Sep 08 19:12:31 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:31 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912" returned: 0 in 0.381s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44048e95-8173-4af3-8af7-a6a3ad391853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083aeedc-98b9-48eb-a5d3-86a48fc74912', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed056097-6564-4b89-ae41-b497e3fbd571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Volume volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 (083aeedc-98b9-48eb-a5d3-86a48fc74912): created successfully Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed056097-6564-4b89-ae41-b497e3fbd571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Flow 'volume_create_manager' (3374d349-2fc7-4706-963a-5606ee942aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d891e344-f335-4d6b-9b5a-48e4688e5026 tempest-TestServerVolumeAttachmentScenario-165747812 None] Created volume successfully. Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (7e768784-d876-41a2-83db-533a87500e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a07619-9d0e-42ce-8806-2784d2059180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a07619-9d0e-42ce-8806-2784d2059180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997021266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:33Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc88829-3267-4517-8de7-fde0cbc26dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc88829-3267-4517-8de7-fde0cbc26dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c89bbb-0779-43fe-9427-0b896aee6327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c89bbb-0779-43fe-9427-0b896aee6327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e', 'volume_name': 'volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a7de61-e926-411f-97b9-3cdba69ee72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a7de61-e926-411f-97b9-3cdba69ee72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24f8abf-0e69-4467-8e2e-e011461ba144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:33 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Volume c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e', 'volume_size': 1} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997021266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:33Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Creating volume c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:33 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:33 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e 1073741824 Sep 08 19:12:33 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (7818a5ac-43a7-486c-85c8-a238b85eea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13745cf4-0fb8-470a-bf1d-bc685f6beace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13745cf4-0fb8-470a-bf1d-bc685f6beace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1345733775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c75b731-85d2-4eb4-a389-765b715202b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:34Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223594a1-69e5-4851-b656-3fa476f548da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223594a1-69e5-4851-b656-3fa476f548da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b6a9b6-40e9-4155-9dab-ceede7ffb897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b6a9b6-40e9-4155-9dab-ceede7ffb897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c75b731-85d2-4eb4-a389-765b715202b1', 'volume_name': 'volume-9c75b731-85d2-4eb4-a389-765b715202b1', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c34a47-8524-4338-b379-580f09f30322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c34a47-8524-4338-b379-580f09f30322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9c35b8-46c8-4c5d-aaa5-579b04547faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Volume 9c75b731-85d2-4eb4-a389-765b715202b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c75b731-85d2-4eb4-a389-765b715202b1', 'volume_size': 1} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:34 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:34 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:34 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e 1073741824" returned: 0 in 0.842s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:34 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e Sep 08 19:12:34 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (5074c050-59c1-4461-8fd5-ed4ea2b68770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b12067e-b17d-49ca-b3f1-ec20ca7ab1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b12067e-b17d-49ca-b3f1-ec20ca7ab1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635413068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed6bd00-5475-40b2-b250-768871467a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:34Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473951ee-a1b0-4404-940b-4dd8dda05508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473951ee-a1b0-4404-940b-4dd8dda05508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6bb18b-8f2a-4e03-8a74-9e732ca9b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6bb18b-8f2a-4e03-8a74-9e732ca9b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed6bd00-5475-40b2-b250-768871467a46', 'volume_name': 'volume-1ed6bd00-5475-40b2-b250-768871467a46', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3792cb59-448c-490e-9b63-303e3ef7b4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3792cb59-448c-490e-9b63-303e3ef7b4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a149c66f-a900-4cb3-a89d-ad933232af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Volume 1ed6bd00-5475-40b2-b250-768871467a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed6bd00-5475-40b2-b250-768871467a46', 'volume_size': 1} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:34 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e" returned: 0 in 0.487s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.633s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1345733775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c75b731-85d2-4eb4-a389-765b715202b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:34Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Creating volume 9c75b731-85d2-4eb4-a389-765b715202b1 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:35 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:35 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:35 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 1073741824 Sep 08 19:12:35 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.695s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24f8abf-0e69-4467-8e2e-e011461ba144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafcd30c-c04a-4806-9b40-08e486fa6fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:12:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Volume volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e (c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e): created successfully Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafcd30c-c04a-4806-9b40-08e486fa6fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (7e768784-d876-41a2-83db-533a87500e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (27f1c084-32bb-409f-b0dc-f082ec389414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067dbc99-747b-43ad-af64-296087368248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (067dbc99-747b-43ad-af64-296087368248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143222786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7540573b-056d-4ebd-b3dc-84aa6c5a5f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:35Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babba0ad-4036-438d-8aa2-b3ac9b08e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babba0ad-4036-438d-8aa2-b3ac9b08e895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd55918-bdc2-4a4b-81f1-14f98d3d45a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd55918-bdc2-4a4b-81f1-14f98d3d45a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7540573b-056d-4ebd-b3dc-84aa6c5a5f6d', 'volume_name': 'volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d19d86-a801-4d6d-821f-b6cd3ccda601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d19d86-a801-4d6d-821f-b6cd3ccda601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2354fdb-5ca8-458e-9900-355afd35740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Volume 7540573b-056d-4ebd-b3dc-84aa6c5a5f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d', 'volume_size': 1} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c6b605d3-b901-49fe-9ec3-59c0ff7d2707 tempest-CreateVolumesFromImageTest-619506628 None] Created volume successfully. Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (fca365cf-039d-4b48-871c-29b5acee511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f4e4d5-bf68-46af-8219-3b8876cad334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f4e4d5-bf68-46af-8219-3b8876cad334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219209862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac00ed0-5bd4-47e1-bb17-10a25b272af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:36Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6404cf2-bce6-4b16-9148-92e7bc19f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6404cf2-bce6-4b16-9148-92e7bc19f175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fefcf4f-d8dd-48a2-88fb-de4740498e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fefcf4f-d8dd-48a2-88fb-de4740498e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac00ed0-5bd4-47e1-bb17-10a25b272af0', 'volume_name': 'volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fa816c-3c5a-4288-9fbf-ec677574bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fa816c-3c5a-4288-9fbf-ec677574bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b08cce-2fd9-44b4-abc9-54a040fd320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Volume fac00ed0-5bd4-47e1-bb17-10a25b272af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0', 'volume_size': 1} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:35 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 1073741824" returned: 0 in 0.770s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:35 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 Sep 08 19:12:35 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:36 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1" returned: 0 in 0.423s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.592s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635413068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed6bd00-5475-40b2-b250-768871467a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:34Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Creating volume 1ed6bd00-5475-40b2-b250-768871467a46 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:36 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9c35b8-46c8-4c5d-aaa5-579b04547faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c75b731-85d2-4eb4-a389-765b715202b1', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:36 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 1073741824 Sep 08 19:12:36 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4997598e-0118-4f78-8af8-9aa9ef6d5e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Volume volume-9c75b731-85d2-4eb4-a389-765b715202b1 (9c75b731-85d2-4eb4-a389-765b715202b1): created successfully Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4997598e-0118-4f78-8af8-9aa9ef6d5e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (7818a5ac-43a7-486c-85c8-a238b85eea6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-df46452f-9cc8-4523-bf43-a3d07a4efe77 tempest-CreateVolumesFromImageTest-619506628 None] Created volume successfully. Sep 08 19:12:37 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 1073741824" returned: 0 in 0.738s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:37 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 Sep 08 19:12:37 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:37 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46" returned: 0 in 0.388s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.253s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1143222786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7540573b-056d-4ebd-b3dc-84aa6c5a5f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:35Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Creating volume 7540573b-056d-4ebd-b3dc-84aa6c5a5f6d {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:37 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:37 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d 1073741824 Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a149c66f-a900-4cb3-a89d-ad933232af25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed6bd00-5475-40b2-b250-768871467a46', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:37 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df0b3de-d905-4555-a2e7-913e0d33d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:37 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Volume volume-1ed6bd00-5475-40b2-b250-768871467a46 (1ed6bd00-5475-40b2-b250-768871467a46): created successfully Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df0b3de-d905-4555-a2e7-913e0d33d67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (5074c050-59c1-4461-8fd5-ed4ea2b68770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9e8e1fa4-95db-4db2-afc5-a072a5b1ba91 tempest-CreateVolumesFromImageTest-619506628 None] Created volume successfully. Sep 08 19:12:38 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d 1073741824" returned: 0 in 0.656s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:38 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d Sep 08 19:12:38 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:38 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219209862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac00ed0-5bd4-47e1-bb17-10a25b272af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d74b8f6c84337a9e543e15bbde970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:36Z,use_quota=True,user_id='2232010fcd014a5cb8459c667e88afc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Creating volume fac00ed0-5bd4-47e1-bb17-10a25b272af0 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:38 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2354fdb-5ca8-458e-9900-355afd35740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:38 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 1073741824 Sep 08 19:12:38 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a0254e-96ca-4a8e-b463-d544133045e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:38 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Volume volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d (7540573b-056d-4ebd-b3dc-84aa6c5a5f6d): created successfully Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9a0254e-96ca-4a8e-b463-d544133045e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (27f1c084-32bb-409f-b0dc-f082ec389414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f04ca3e4-c99a-40c0-8b42-97b98cb6e05c tempest-CreateVolumesFromImageTest-619506628 None] Created volume successfully. Sep 08 19:12:39 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 1073741824" returned: 0 in 0.620s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:39 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 Sep 08 19:12:39 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:39 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0" returned: 0 in 0.304s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b08cce-2fd9-44b4-abc9-54a040fd320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaf7ee1-510d-4334-b228-5c2f83a55da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:39 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Volume volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 (fac00ed0-5bd4-47e1-bb17-10a25b272af0): created successfully Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaf7ee1-510d-4334-b228-5c2f83a55da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Flow 'volume_create_manager' (fca365cf-039d-4b48-871c-29b5acee511a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-28c850da-c00b-4228-8427-d381e5b0ec20 tempest-CreateVolumesFromImageTest-619506628 None] Created volume successfully. Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-fac00ed0-5bd4-47e1-bb17-10a25b272af0-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-fac00ed0-5bd4-47e1-bb17-10a25b272af0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-quobyte-fac00ed0-5bd4-47e1-bb17-10a25b272af0" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-fac00ed0-5bd4-47e1-bb17-10a25b272af0" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e4d8ff-b2d1-4aa6-a3bb-fa3a5cb64ece]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:40 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 Sep 08 19:12:40 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:40 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0" returned: 0 in 0.475s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:41 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0 Sep 08 19:12:41 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:41 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fac00ed0-5bd4-47e1-bb17-10a25b272af0" returned: 0 in 0.390s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-fac00ed0-5bd4-47e1-bb17-10a25b272af0" released by "delete_volume" :: held 0.941s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Created reservations ['0af3575f-cae5-4890-87f0-62410df9c5e4', 'a887bbf5-b2df-47c6-b765-de6a5678db41', '46d3ca76-9db5-4f38-b593-1dbd6b04ab04', '80eb9fa5-c860-46ac-ae18-f03fa910c6a9'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:41 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:41 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:41 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.329s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Deleted volume successfully. Sep 08 19:12:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-565be38c-4179-4283-b681-aa14a8cdfe93 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-fac00ed0-5bd4-47e1-bb17-10a25b272af0-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-quobyte-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:42 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5215f3-6c25-4e5f-affe-ec323a628d94]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:43 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d Sep 08 19:12:43 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Flow 'volume_create_manager' (7851d96a-5a3a-42f8-aadf-b9b2aa21d392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccf7156-cd74-4de8-aa25-66b995cdc064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccf7156-cd74-4de8-aa25-66b995cdc064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-590352981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a65105-f0a9-4692-9f38-ec8bed717ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adc7b3afbaf4530b50e39904177e8f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:43Z,use_quota=True,user_id='65841090c121477da9b970f2eddfa0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688b3f5e-b72b-41b6-9215-515aaa144a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:43 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688b3f5e-b72b-41b6-9215-515aaa144a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c49e13-a469-4855-adc1-c2ae723cb663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c49e13-a469-4855-adc1-c2ae723cb663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a65105-f0a9-4692-9f38-ec8bed717ee6', 'volume_name': 'volume-27a65105-f0a9-4692-9f38-ec8bed717ee6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135b9f1e-a103-4641-9cd1-3712dc401675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135b9f1e-a103-4641-9cd1-3712dc401675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bcbf5f-047f-42c6-9ff8-837a0d087998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:43 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Volume 27a65105-f0a9-4692-9f38-ec8bed717ee6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a65105-f0a9-4692-9f38-ec8bed717ee6', 'volume_size': 1} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-590352981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a65105-f0a9-4692-9f38-ec8bed717ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7adc7b3afbaf4530b50e39904177e8f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:43Z,use_quota=True,user_id='65841090c121477da9b970f2eddfa0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Creating volume 27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:43 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d" returned: 0 in 0.638s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:43 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 1073741824 Sep 08 19:12:43 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:43 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d Sep 08 19:12:43 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:43 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d" released by "delete_volume" :: held 1.016s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Created reservations ['596ef1d3-6907-402b-818b-60df7be13711', 'cd5558e8-8cf0-4a1c-8214-83c4038dc402', '98fd4363-4938-43c5-8420-7c39097d95f6', '2397e863-a81c-4a4d-bd50-d36babc1df7d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:44 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:44 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:44 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 1073741824" returned: 0 in 0.607s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:44 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 Sep 08 19:12:44 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:44 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Deleted volume successfully. Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-441fd8ac-7303-45eb-a346-39adb2a6c48b tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-7540573b-056d-4ebd-b3dc-84aa6c5a5f6d-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:44 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bcbf5f-047f-42c6-9ff8-837a0d087998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a65105-f0a9-4692-9f38-ec8bed717ee6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4306f5-7f3e-415c-bd47-eefb7f14723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:44 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Volume volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 (27a65105-f0a9-4692-9f38-ec8bed717ee6): created successfully Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4306f5-7f3e-415c-bd47-eefb7f14723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Flow 'volume_create_manager' (7851d96a-5a3a-42f8-aadf-b9b2aa21d392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-ae6e2997-383d-46ce-acff-ab48fd059246 req-f9d04754-9b78-4411-b1bf-26ef82104301 tempest-VolumesSnapshotsTestJSON-1595970061 None] Created volume successfully. Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-1ed6bd00-5475-40b2-b250-768871467a46-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-1ed6bd00-5475-40b2-b250-768871467a46-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-quobyte-1ed6bd00-5475-40b2-b250-768871467a46" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-1ed6bd00-5475-40b2-b250-768871467a46" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3e6728-9c7d-46f2-a9c1-f4884a6516c1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:45 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 Sep 08 19:12:45 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:45 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46" returned: 0 in 0.773s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:46 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46 Sep 08 19:12:46 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Creating offline snapshot 9a6d8ab5-6885-47df-bc35-03942ab66467 of volume 27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe43ff-8491-4c53-a7fc-bf39a6aca222]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:46 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-1ed6bd00-5475-40b2-b250-768871467a46" returned: 0 in 0.673s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-1ed6bd00-5475-40b2-b250-768871467a46" released by "delete_volume" :: held 1.546s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:46 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 Sep 08 19:12:46 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Created reservations ['db5acaa0-4cee-4242-a9d4-87f5ac1d658f', '7c7a402c-e14e-46a3-9165-8ca6fc4e8fed', '720fa89a-c9fd-44c6-8871-3ef6e10ca9a3', 'e8f3f515-17b4-476c-aeed-8990aeff582a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:47 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:47 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:47 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6" returned: 0 in 0.761s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:47 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 1G Sep 08 19:12:47 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-9c75b731-85d2-4eb4-a389-765b715202b1-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-9c75b731-85d2-4eb4-a389-765b715202b1-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:47 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-quobyte-9c75b731-85d2-4eb4-a389-765b715202b1" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.842s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-9c75b731-85d2-4eb4-a389-765b715202b1" acquired by "delete_volume" :: waited 0.062s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:47 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Deleted volume successfully. Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d079ced2-e9d9-4adf-8402-d42146f4337f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cc8ffa1a-5418-4b76-a280-0cb9f03376bf tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-1ed6bd00-5475-40b2-b250-768871467a46-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:48 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 Sep 08 19:12:48 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:48 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 1G" returned: 0 in 1.059s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:48 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 Sep 08 19:12:48 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:48 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1" returned: 0 in 0.686s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:48 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1 Sep 08 19:12:48 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:49 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467" returned: 0 in 0.728s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:49 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 is being set with open permissions: ugo+rw Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:49 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 Sep 08 19:12:49 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:49 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9c75b731-85d2-4eb4-a389-765b715202b1" returned: 0 in 0.569s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-9c75b731-85d2-4eb4-a389-765b715202b1" released by "delete_volume" :: held 1.393s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Created reservations ['85aa0c72-b6b0-477b-97e6-74332aeed415', '1df749c7-7fd2-4a54-82e0-e10402e3fcff', 'f6962940-024f-432a-b906-6986bfb15ba6', '2eaed7df-6378-4ef0-b9b3-7246c721df94'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:49 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:49 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:49 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467" returned: 0 in 0.600s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:49 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:49 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.info Sep 08 19:12:49 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.398s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Deleted volume successfully. Sep 08 19:12:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5029cffd-79cf-4823-9903-cbd192414957 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-9c75b731-85d2-4eb4-a389-765b715202b1-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:50 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.info" returned: 0 in 0.458s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:50 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.info is being set with open permissions: ugo+rw Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "cinder-quobyte-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:50 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.info Sep 08 19:12:50 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e" acquired by "delete_volume" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7667e90f-cad4-444f-905d-680df3feb1f8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:50 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e Sep 08 19:12:50 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:50 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.info" returned: 0 in 0.421s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.280s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:50 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-be978843-74c2-4f2e-b056-0e27dc194c38 req-aa023dd3-5905-4625-9ff7-55cde26303c3 tempest-VolumesSnapshotsTestJSON-1595970061 None] Create snapshot completed successfully Sep 08 19:12:50 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e" returned: 0 in 0.503s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:50 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e Sep 08 19:12:50 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:51 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e" returned: 0 in 0.475s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-quobyte-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e" released by "delete_volume" :: held 1.058s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Created reservations ['517a5260-aee4-46b9-bc01-269ee25f95a8', 'd66181e0-d935-45c0-9c2c-856f29fb1918', '625735f3-b657-42a4-9975-6d727c4e4eae', '511898f7-8dd4-4568-a76c-d1eab9f5317a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "cinder-9a6d8ab5-6885-47df-bc35-03942ab66467-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-9a6d8ab5-6885-47df-bc35-03942ab66467-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "cinder-quobyte-27a65105-f0a9-4692-9f38-ec8bed717ee6" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-quobyte-27a65105-f0a9-4692-9f38-ec8bed717ee6" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "cinder-quobyte-9a6d8ab5-6885-47df-bc35-03942ab66467" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:51 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:51 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-quobyte-9a6d8ab5-6885-47df-bc35-03942ab66467" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Deleting offline snapshot 9a6d8ab5-6885-47df-bc35-03942ab66467 of volume 27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] snapshot_file for this snap is: volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ecc099-56a9-4cef-a92d-4e9f8403c9ed]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:51 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 Sep 08 19:12:51 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:51 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.375s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:51 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Deleted volume successfully. Sep 08 19:12:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c8bca8ab-d2ca-4fa9-9c82-bcb441b63b91 tempest-CreateVolumesFromImageTest-619506628 None] Lock "cinder-c607f1aa-6cd3-4e16-ac6a-8a7a3867ad0e-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:52 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467" returned: 0 in 0.562s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27a65105-f0a9-4692-9f38-ec8bed717ee6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:12:52 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d00bd6-30cc-4056-b172-83af2f1c49f0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:52 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 Sep 08 19:12:52 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:53 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6" returned: 0 in 0.925s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:53 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 Sep 08 19:12:53 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:54 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467" returned: 0 in 0.810s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:54 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467 Sep 08 19:12:54 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:54 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6.9a6d8ab5-6885-47df-bc35-03942ab66467" returned: 0 in 0.622s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-quobyte-9a6d8ab5-6885-47df-bc35-03942ab66467" released by "_delete_snapshot" :: held 3.142s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-quobyte-27a65105-f0a9-4692-9f38-ec8bed717ee6" released by "delete_snapshot" :: held 3.229s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:54 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Flow 'volume_create_manager' (53accbc7-9d67-4181-8aaa-035bc306851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7e01be-2999-4d93-b06d-b4d805929a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7e01be-2999-4d93-b06d-b4d805929a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1048860618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4b0da0-42e9-444d-8410-25dbb888e1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff78267a16f44f181fbfecd2f8a608b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:55Z,use_quota=True,user_id='e55f35a28c1049d3be1ae9b6a67ee443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6fb2a4-a9b9-4f1b-83dd-7c81a531a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea6fb2a4-a9b9-4f1b-83dd-7c81a531a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e9c568-643d-4767-bc3e-eb0162ef2142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e9c568-643d-4767-bc3e-eb0162ef2142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4b0da0-42e9-444d-8410-25dbb888e1fd', 'volume_name': 'volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89825346-9776-40bc-bbef-a58e80e4253b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89825346-9776-40bc-bbef-a58e80e4253b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f1663-b758-4890-a4a4-4f7f488c2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:55 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Volume 7f4b0da0-42e9-444d-8410-25dbb888e1fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd', 'volume_size': 1} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1048860618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4b0da0-42e9-444d-8410-25dbb888e1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff78267a16f44f181fbfecd2f8a608b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:55Z,use_quota=True,user_id='e55f35a28c1049d3be1ae9b6a67ee443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Creating volume 7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:55 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:55 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd 1073741824 Sep 08 19:12:55 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.quota [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Created reservations ['d8a9630e-5435-40e6-98b7-f2c40ff857d9', 'a9e90621-96da-4a19-92ea-30e5a1e36a72', 'b60580b2-785d-44d3-b158-18bd6d8ae713', 'e7a51448-a90e-403c-b359-ec881d4eedec'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Delete snapshot completed successfully. Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-1289ec87-ee1c-453e-9229-a425a724f6a9 req-d45b084b-57b1-4b52-ac12-0a3bad3e32d4 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-9a6d8ab5-6885-47df-bc35-03942ab66467-delete_snapshot" released by "delete_snapshot" :: held 3.812s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:55 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd 1073741824" returned: 0 in 0.535s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:55 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd Sep 08 19:12:55 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:56 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd" returned: 0 in 0.315s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820f1663-b758-4890-a4a4-4f7f488c2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8866ad13-8c9d-4684-9ba0-8b2cac7515a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:56 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Volume volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd (7f4b0da0-42e9-444d-8410-25dbb888e1fd): created successfully Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8866ad13-8c9d-4684-9ba0-8b2cac7515a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Flow 'volume_create_manager' (53accbc7-9d67-4181-8aaa-035bc306851d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6043effe-537e-4395-a11c-bfac7e7c0f0f tempest-SnapshotDependencyTests-1736036629 None] Created volume successfully. Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "cinder-27a65105-f0a9-4692-9f38-ec8bed717ee6-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-27a65105-f0a9-4692-9f38-ec8bed717ee6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "cinder-quobyte-27a65105-f0a9-4692-9f38-ec8bed717ee6" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-quobyte-27a65105-f0a9-4692-9f38-ec8bed717ee6" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0fe95-fef2-4f30-9406-2947d2cb849f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:56 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 Sep 08 19:12:56 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:56 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6" returned: 0 in 0.429s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:56 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6 Sep 08 19:12:56 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:57 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-27a65105-f0a9-4692-9f38-ec8bed717ee6" returned: 0 in 0.366s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Creating offline snapshot ec1148f4-3fd6-44a8-a67e-728959196379 of volume 7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-quobyte-27a65105-f0a9-4692-9f38-ec8bed717ee6" released by "delete_volume" :: held 0.875s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[01623bf5-1119-4f04-95b5-801c708b1046]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.quota [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Created reservations ['1f5fe748-1e89-48a4-b7d1-96522444b4c7', '0c311bb2-dcde-4286-a57a-790b1d6985e7', 'ed899800-a7df-4068-b83e-8d950d6f6dd0', '1802e613-1010-4282-a22c-0d650307f471'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:12:57 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd Sep 08 19:12:57 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:57 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:12:57 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (517b8007-41b4-4579-b3c8-901e7a8982c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:12:57 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade2f91e-aef4-4c50-b0e5-03e314e80b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd" returned: 0 in 0.553s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade2f91e-aef4-4c50-b0e5-03e314e80b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628759965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079ad202-d97f-4a0c-ae0e-f4f3387c443c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:58Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0c5db4-7506-4db9-b32a-f56f95138bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0c5db4-7506-4db9-b32a-f56f95138bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:57 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 1G Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08aeba2-4ccd-41b0-86d7-bba333081e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:57 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08aeba2-4ccd-41b0-86d7-bba333081e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '079ad202-d97f-4a0c-ae0e-f4f3387c443c', 'volume_name': 'volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c710949-1f45-4818-8358-31c94e0806cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c710949-1f45-4818-8358-31c94e0806cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6b6053-3c23-4006-8c6a-bfab6c20913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:12:57 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume 079ad202-d97f-4a0c-ae0e-f4f3387c443c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c', 'volume_size': 1} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:57 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.414s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:57 devstack cinder-volume[87538]: DEBUG cinder.manager [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:57 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Deleted volume successfully. Sep 08 19:12:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-b67e2805-c6f1-4f60-a3b7-fd5a26625c3e req-fe820317-14d5-4090-a56b-c2636f73d4f9 tempest-VolumesSnapshotsTestJSON-1595970061 None] Lock "cinder-27a65105-f0a9-4692-9f38-ec8bed717ee6-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:12:58 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 1G" returned: 0 in 0.538s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:58 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 Sep 08 19:12:58 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:58 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379" returned: 0 in 0.361s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:58 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 is being set with open permissions: ugo+rw Sep 08 19:12:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:58 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 Sep 08 19:12:58 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:59 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379" returned: 0 in 0.310s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:59 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.info Sep 08 19:12:59 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:59 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.info" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:59 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.info is being set with open permissions: ugo+rw Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:59 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.info Sep 08 19:12:59 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:59 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.info" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1628759965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079ad202-d97f-4a0c-ae0e-f4f3387c443c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:12:58Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Creating volume 079ad202-d97f-4a0c-ae0e-f4f3387c443c {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:12:59 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:12:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:59 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c 1073741824 Sep 08 19:12:59 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ad5a58e5-dc32-4eb8-8788-728c99f652e1 tempest-SnapshotDependencyTests-1736036629 None] Create snapshot completed successfully Sep 08 19:13:00 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c 1073741824" returned: 0 in 0.484s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:00 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c Sep 08 19:13:00 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:00 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c" returned: 0 in 0.287s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6b6053-3c23-4006-8c6a-bfab6c20913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95b9f9b-7877-4c47-a84f-50955f513962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:00 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c (079ad202-d97f-4a0c-ae0e-f4f3387c443c): created successfully Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95b9f9b-7877-4c47-a84f-50955f513962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (517b8007-41b4-4579-b3c8-901e7a8982c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0c942c42-57d0-4f5f-b96d-82a86d18d7a4 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created volume successfully. Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Flow 'volume_create_manager' (70f1dbcb-1ce6-4354-9895-00210f598446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54887a9a-9633-4336-873c-c61eef2a7477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54887a9a-9633-4336-873c-c61eef2a7477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be52ead-0b94-41bf-ae36-0a4e7f7c95bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bff78267a16f44f181fbfecd2f8a608b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec1148f4-3fd6-44a8-a67e-728959196379,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:01Z,use_quota=True,user_id='e55f35a28c1049d3be1ae9b6a67ee443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ccc536-7172-4cf6-aba9-585b950b0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ccc536-7172-4cf6-aba9-585b950b0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fd8fbc-b1c0-4b2a-be7c-312f616fbef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07fd8fbc-b1c0-4b2a-be7c-312f616fbef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2be52ead-0b94-41bf-ae36-0a4e7f7c95bf', 'volume_name': 'volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf', 'volume_size': 1, 'snapshot_id': 'ec1148f4-3fd6-44a8-a67e-728959196379'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e4c84c-2b34-4e49-9bf0-bf94c5e0a5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e4c84c-2b34-4e49-9bf0-bf94c5e0a5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef152ae-5939-47a3-8ebc-02c848e47242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Volume 2be52ead-0b94-41bf-ae36-0a4e7f7c95bf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf', 'volume_size': 1, 'snapshot_id': 'ec1148f4-3fd6-44a8-a67e-728959196379'} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-quobyte-ec1148f4-3fd6-44a8-a67e-728959196379-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-ec1148f4-3fd6-44a8-a67e-728959196379-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Creating volume 2be52ead-0b94-41bf-ae36-0a4e7f7c95bf from snapshot ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-quobyte-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] snapshot: ec1148f4-3fd6-44a8-a67e-728959196379, volume: 2be52ead-0b94-41bf-ae36-0a4e7f7c95bf, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6f23f-84fc-496a-abca-28e76edeb204]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:01 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 Sep 08 19:13:01 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (ff418355-5edf-4ba0-b5b1-2200a83c4771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bfca2b-45e8-4c82-9c78-db9efc4c7a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bfca2b-45e8-4c82-9c78-db9efc4c7a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493035587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759af9b6-36c3-4727-b498-d8057b5b7940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:01Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80715056-145a-428d-80cf-bb0e9abe6c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80715056-145a-428d-80cf-bb0e9abe6c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8627283a-8934-4722-8d26-139962237e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8627283a-8934-4722-8d26-139962237e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759af9b6-36c3-4727-b498-d8057b5b7940', 'volume_name': 'volume-759af9b6-36c3-4727-b498-d8057b5b7940', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf814dd2-8dd5-4f96-84c0-17afef53ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf814dd2-8dd5-4f96-84c0-17afef53ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786e7d23-8c20-43e8-804a-fcd6e82f477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume 759af9b6-36c3-4727-b498-d8057b5b7940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759af9b6-36c3-4727-b498-d8057b5b7940', 'volume_size': 1} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (c16a2188-902a-4937-9e08-48ad2ede4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b21811-58ad-4590-83d9-a2b26671ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b21811-58ad-4590-83d9-a2b26671ae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450296650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a52170-28b3-4572-9a01-d9a8e5f58eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:02Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d3a32a-8e13-48e8-95cd-e814fa1408fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d3a32a-8e13-48e8-95cd-e814fa1408fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d06443-82a5-4d31-8b80-086023ac355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d06443-82a5-4d31-8b80-086023ac355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a52170-28b3-4572-9a01-d9a8e5f58eef', 'volume_name': 'volume-37a52170-28b3-4572-9a01-d9a8e5f58eef', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca3f727-fb0c-4175-8c53-c1a95e9aa8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca3f727-fb0c-4175-8c53-c1a95e9aa8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d4bef9-549a-4754-817b-e736a438bc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume 37a52170-28b3-4572-9a01-d9a8e5f58eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a52170-28b3-4572-9a01-d9a8e5f58eef', 'volume_size': 1} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379" returned: 0 in 0.695s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9549706-bad0-4ba8-aaf8-c0146b05af34]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:02 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd Sep 08 19:13:02 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (7170a6b1-9f58-4ec5-b212-a761c360b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d07f80-f0da-4110-898d-b39e0ae2e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d07f80-f0da-4110-898d-b39e0ae2e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-705972393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6728cb6-3883-4a93-9b0a-c66e80f40028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:02Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5e3f18-d1b6-477d-a9ab-240b110b6eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5e3f18-d1b6-477d-a9ab-240b110b6eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16703547-9c18-4c2f-a97d-748e660fba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16703547-9c18-4c2f-a97d-748e660fba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6728cb6-3883-4a93-9b0a-c66e80f40028', 'volume_name': 'volume-f6728cb6-3883-4a93-9b0a-c66e80f40028', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4f56a3-ea55-4a57-8c09-8eb55e162b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4f56a3-ea55-4a57-8c09-8eb55e162b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a2f45d-5185-4524-ba4a-a3c4e5a5878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume f6728cb6-3883-4a93-9b0a-c66e80f40028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6728cb6-3883-4a93-9b0a-c66e80f40028', 'volume_size': 1} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:02 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd" returned: 0 in 0.461s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:02 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf Sep 08 19:13:02 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (5c32c941-ad38-4b95-bd07-5fe92523081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9b889d-87bb-4194-9b94-74b39f14b389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9b889d-87bb-4194-9b94-74b39f14b389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014238923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509c7341-1859-42a9-9555-f2874e53d693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:03Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5b9d5c-b247-49b3-b1e1-9a3e6336dab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5b9d5c-b247-49b3-b1e1-9a3e6336dab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66841107-4b23-4414-8b53-18f20a1246a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66841107-4b23-4414-8b53-18f20a1246a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509c7341-1859-42a9-9555-f2874e53d693', 'volume_name': 'volume-509c7341-1859-42a9-9555-f2874e53d693', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5adab3d-4997-42c4-9cd1-23b42d1c89b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5adab3d-4997-42c4-9cd1-23b42d1c89b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa148c3-fdf2-4997-a740-b34baaf2611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume 509c7341-1859-42a9-9555-f2874e53d693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509c7341-1859-42a9-9555-f2874e53d693', 'volume_size': 1} Sep 08 19:13:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (461f33fa-7735-44fe-b52e-e3eb35ec619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375f09c9-d6a0-4684-9290-8e2075b0fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375f09c9-d6a0-4684-9290-8e2075b0fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279171264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:04Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ca664d-3a9b-4149-a9f1-fa492636ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ca664d-3a9b-4149-a9f1-fa492636ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3af4912-fc7a-4f19-bf82-ab2206c4e6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3af4912-fc7a-4f19-bf82-ab2206c4e6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b', 'volume_name': 'volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de3ede8-cce0-4a4c-bfc1-719c144cb2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de3ede8-cce0-4a4c-bfc1-719c144cb2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91990952-7a97-4482-87db-65324738085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:03 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b', 'volume_size': 1} Sep 08 19:13:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:07 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" returned: 0 in 5.158s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:07 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:13:07 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Converted 1024.00 MB image at 198.47 MB/s Sep 08 19:13:07 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf is being set with open permissions: ugo+rw Sep 08 19:13:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:07 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf Sep 08 19:13:07 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:07 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" returned: 0 in 0.303s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" released by "_copy_volume_from_snapshot" :: held 6.740s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-ec1148f4-3fd6-44a8-a67e-728959196379-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" released by "_create_volume_from_snapshot" :: held 6.820s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.838s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.356s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-493035587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759af9b6-36c3-4727-b498-d8057b5b7940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:01Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Creating volume 759af9b6-36c3-4727-b498-d8057b5b7940 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:08 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:08 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 1073741824 Sep 08 19:13:08 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef152ae-5939-47a3-8ebc-02c848e47242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf', 'volume_size': 1, 'snapshot_id': 'ec1148f4-3fd6-44a8-a67e-728959196379'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c434d4a-e713-47b4-855b-0232c9167626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Volume volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf (2be52ead-0b94-41bf-ae36-0a4e7f7c95bf): created successfully Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c434d4a-e713-47b4-855b-0232c9167626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Flow 'volume_create_manager' (70f1dbcb-1ce6-4354-9895-00210f598446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:08 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0eaff6c9-ecd4-44c5-8998-0e708c7dfd77 tempest-SnapshotDependencyTests-1736036629 None] Created volume successfully. Sep 08 19:13:08 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 1073741824" returned: 0 in 0.485s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:08 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 Sep 08 19:13:08 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:08 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940" returned: 0 in 0.254s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.811s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450296650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a52170-28b3-4572-9a01-d9a8e5f58eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:02Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Creating volume 37a52170-28b3-4572-9a01-d9a8e5f58eef {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:08 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786e7d23-8c20-43e8-804a-fcd6e82f477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759af9b6-36c3-4727-b498-d8057b5b7940', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:08 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef 1073741824 Sep 08 19:13:08 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5034ba-c89a-4217-86b2-1197fb11a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume volume-759af9b6-36c3-4727-b498-d8057b5b7940 (759af9b6-36c3-4727-b498-d8057b5b7940): created successfully Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5034ba-c89a-4217-86b2-1197fb11a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (ff418355-5edf-4ba0-b5b1-2200a83c4771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:08 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b44239a6-683a-4eb9-ba1a-8b602a38ad9f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created volume successfully. Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-ec1148f4-3fd6-44a8-a67e-728959196379-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-ec1148f4-3fd6-44a8-a67e-728959196379-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-quobyte-7f4b0da0-42e9-444d-8410-25dbb888e1fd" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-7f4b0da0-42e9-444d-8410-25dbb888e1fd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-quobyte-ec1148f4-3fd6-44a8-a67e-728959196379" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-ec1148f4-3fd6-44a8-a67e-728959196379" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Deleting offline snapshot ec1148f4-3fd6-44a8-a67e-728959196379 of volume 7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] snapshot_file for this snap is: volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cddbd75-7c44-4bf3-a9c1-6d0c8bfb4c28]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:09 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 Sep 08 19:13:09 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:09 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef 1073741824" returned: 0 in 0.587s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:09 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef Sep 08 19:13:09 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:09 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379" returned: 0 in 0.427s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe3aa4-f671-499c-ba2f-0e3d4b08e4d7]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:09 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef" returned: 0 in 0.282s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.293s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-705972393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6728cb6-3883-4a93-9b0a-c66e80f40028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:02Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Creating volume f6728cb6-3883-4a93-9b0a-c66e80f40028 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:09 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d4bef9-549a-4754-817b-e736a438bc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a52170-28b3-4572-9a01-d9a8e5f58eef', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:09 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 1073741824 Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61836df6-e921-4bc5-9360-85c255287b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:09 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:09 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume volume-37a52170-28b3-4572-9a01-d9a8e5f58eef (37a52170-28b3-4572-9a01-d9a8e5f58eef): created successfully Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61836df6-e921-4bc5-9360-85c255287b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (c16a2188-902a-4937-9e08-48ad2ede4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:09 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd Sep 08 19:13:09 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bd0f3d2a-f374-4e37-84b5-0d637bda3853 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created volume successfully. Sep 08 19:13:09 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:10 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 1073741824" returned: 0 in 0.525s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:10 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 Sep 08 19:13:10 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:10 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd" returned: 0 in 0.638s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:10 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 Sep 08 19:13:10 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:10 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028" returned: 0 in 0.256s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.731s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1014238923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509c7341-1859-42a9-9555-f2874e53d693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:03Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Creating volume 509c7341-1859-42a9-9555-f2874e53d693 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:10 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:10 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 1073741824 Sep 08 19:13:10 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a2f45d-5185-4524-ba4a-a3c4e5a5878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6728cb6-3883-4a93-9b0a-c66e80f40028', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30327713-ec3b-475e-bce7-55dc3a0a5628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:10 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 (f6728cb6-3883-4a93-9b0a-c66e80f40028): created successfully Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30327713-ec3b-475e-bce7-55dc3a0a5628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (7170a6b1-9f58-4ec5-b212-a761c360b38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-931b558a-27b4-4115-877d-c624098c1f6f tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created volume successfully. Sep 08 19:13:10 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379" returned: 0 in 0.378s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:10 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379 Sep 08 19:13:10 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:11 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd.ec1148f4-3fd6-44a8-a67e-728959196379" returned: 0 in 0.336s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:11 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 1073741824" returned: 0 in 0.529s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-ec1148f4-3fd6-44a8-a67e-728959196379" released by "_delete_snapshot" :: held 1.942s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-7f4b0da0-42e9-444d-8410-25dbb888e1fd" released by "delete_snapshot" :: held 1.974s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:11 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 Sep 08 19:13:11 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Created reservations ['5ed87030-0689-4b5b-912b-134a6ef0534b', '538d5490-7105-4365-9b7d-5c719565f76e', '58253017-13dd-4cb2-a3fd-ad25bfc72c0a', '764e2b32-4eca-409b-8d9b-07bee7f84be5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:11 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Delete snapshot completed successfully. Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2a212825-3c10-4615-80a9-00a820dd1de9 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-ec1148f4-3fd6-44a8-a67e-728959196379-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:11 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.528s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-279171264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='057bf86b4751401597d24653798fcac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:04Z,use_quota=True,user_id='6132704d28044d11a73e82760925c355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Creating volume f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:11 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa148c3-fdf2-4997-a740-b34baaf2611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509c7341-1859-42a9-9555-f2874e53d693', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db290a3-71d2-42d3-835f-1f8cc5ddfe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:11 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b 1073741824 Sep 08 19:13:11 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:11 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume volume-509c7341-1859-42a9-9555-f2874e53d693 (509c7341-1859-42a9-9555-f2874e53d693): created successfully Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db290a3-71d2-42d3-835f-1f8cc5ddfe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (5c32c941-ad38-4b95-bd07-5fe92523081a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:11 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e1bb13a7-0fb2-438c-8835-00ea89af947c tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created volume successfully. Sep 08 19:13:11 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b 1073741824" returned: 0 in 0.468s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:12 devstack sudo[101302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b Sep 08 19:13:12 devstack sudo[101302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:12 devstack sudo[101302]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b" returned: 0 in 0.262s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91990952-7a97-4482-87db-65324738085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb59e1b-9620-4bc0-939a-9c9586255317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:12 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Volume volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b (f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b): created successfully Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb59e1b-9620-4bc0-939a-9c9586255317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Flow 'volume_create_manager' (461f33fa-7735-44fe-b52e-e3eb35ec619e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-80538de9-4998-4061-8839-46623a6a2ae7 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created volume successfully. Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-7f4b0da0-42e9-444d-8410-25dbb888e1fd-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-7f4b0da0-42e9-444d-8410-25dbb888e1fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-quobyte-7f4b0da0-42e9-444d-8410-25dbb888e1fd" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-7f4b0da0-42e9-444d-8410-25dbb888e1fd" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9094d-70e2-4102-a07d-caba1539511c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:12 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd Sep 08 19:13:12 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:12 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd" returned: 0 in 0.370s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:12 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd Sep 08 19:13:12 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:13 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7f4b0da0-42e9-444d-8410-25dbb888e1fd" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-7f4b0da0-42e9-444d-8410-25dbb888e1fd" released by "delete_volume" :: held 0.733s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Created reservations ['5d69e63a-b820-4ea8-8069-2dd87fa624dc', '23b9dcea-1000-4ff7-91fb-593d2ab3bbe9', 'ec0d9127-2445-41f4-ab42-d05ce4b89ac6', '00804ed0-0b79-4ae1-8b9d-a9d44902fb77'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-quobyte-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[72807c4a-27eb-4632-b136-311a5f17761e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:13 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:13 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:13 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b Sep 08 19:13:13 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "cinder-quobyte-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" acquired by "delete_volume" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e951f8b8-a6a6-4092-8073-3fb1d3c6bf68]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:13 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.338s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:13 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Deleted volume successfully. Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-439ce9bb-15b3-440b-93b8-052ea6721501 tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-7f4b0da0-42e9-444d-8410-25dbb888e1fd-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:13 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf Sep 08 19:13:13 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:13 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b" returned: 0 in 0.482s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:13 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b Sep 08 19:13:13 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:14 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" returned: 0 in 0.415s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:14 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf Sep 08 19:13:14 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:14 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b" released by "delete_volume" :: held 0.856s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created reservations ['8c655226-0a8c-4dad-bc54-f02a481ecc25', '4f6b85d2-de25-4fac-8197-6da004e9909d', '0bed7321-2e13-4182-bcf9-641dac2d6ae2', '7e2289a2-14d4-42f4-ba08-7fa62fa7e67e'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:14 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" returned: 0 in 0.331s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:14 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-quobyte-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf" released by "delete_volume" :: held 0.801s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:14 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-509c7341-1859-42a9-9555-f2874e53d693-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Created reservations ['dafe3405-4b4e-44e2-be6a-a3d9834ffa10', 'ab89d3cc-04bf-4aff-9aaa-cb21e3a49e01', '0e31f7b1-1369-468c-94f2-ae594cfb28fa', '193fa3fc-5b4e-4e70-b4b9-7cbf15a267a2'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-509c7341-1859-42a9-9555-f2874e53d693-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-quobyte-509c7341-1859-42a9-9555-f2874e53d693" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-509c7341-1859-42a9-9555-f2874e53d693" acquired by "delete_volume" :: waited 0.044s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:14 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdee68f-682d-4b25-9ea1-5794f6d1ba60]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:14 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:14 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.448s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:14 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Deleted volume successfully. Sep 08 19:13:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0886862f-976f-4bf8-a375-392833ed35b2 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-f56f2e2d-3ab1-41c0-be7d-221f6fb26a1b-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:15 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 Sep 08 19:13:15 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:15 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.469s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Deleted volume successfully. Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-604a9a4b-a28b-4c6c-8bc0-1fa0fe304bda tempest-SnapshotDependencyTests-1736036629 None] Lock "cinder-2be52ead-0b94-41bf-ae36-0a4e7f7c95bf-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:15 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693" returned: 0 in 0.645s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:15 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693 Sep 08 19:13:15 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:15 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-509c7341-1859-42a9-9555-f2874e53d693" returned: 0 in 0.286s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-509c7341-1859-42a9-9555-f2874e53d693" released by "delete_volume" :: held 1.039s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:15 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created reservations ['827cbb45-0921-4c52-b98f-64b86e4a9fc1', '6a4fef12-d029-4f43-aa31-d6591dae0d18', 'af04adfc-6128-427e-be04-4fc9308c1844', 'd471300d-ccab-46c6-88d6-5e3b48bd5f57'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:16 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:16 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-bd9cd951-6661-4947-8658-7a260aa724b0 req-fe65054b-acb0-4f59-a03c-a6dba681e256 tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-bd9cd951-6661-4947-8658-7a260aa724b0 req-fe65054b-acb0-4f59-a03c-a6dba681e256 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-bd9cd951-6661-4947-8658-7a260aa724b0 req-fe65054b-acb0-4f59-a03c-a6dba681e256 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:16 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.345s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Deleted volume successfully. Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-bd9cd951-6661-4947-8658-7a260aa724b0 req-fe65054b-acb0-4f59-a03c-a6dba681e256 tempest-TestServerVolumeAttachmentScenario-165747812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86117ac9-29d5-4c7c-a0b0-b9aad40305d4', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:13:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-bcea0c06-46d2-4c4e-878a-635184ed98f9 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-509c7341-1859-42a9-9555-f2874e53d693-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-bd9cd951-6661-4947-8658-7a260aa724b0 req-fe65054b-acb0-4f59-a03c-a6dba681e256 tempest-TestServerVolumeAttachmentScenario-165747812 None] attachment_update completed successfully. Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-f6728cb6-3883-4a93-9b0a-c66e80f40028-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-f6728cb6-3883-4a93-9b0a-c66e80f40028-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-quobyte-f6728cb6-3883-4a93-9b0a-c66e80f40028" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-f6728cb6-3883-4a93-9b0a-c66e80f40028" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bff1305-4891-4a08-a519-1066f32221be]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:17 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 Sep 08 19:13:17 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:17 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028" returned: 0 in 0.488s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:17 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028 Sep 08 19:13:17 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:17 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f6728cb6-3883-4a93-9b0a-c66e80f40028" returned: 0 in 0.289s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-f6728cb6-3883-4a93-9b0a-c66e80f40028" released by "delete_volume" :: held 0.856s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created reservations ['436a9d2c-2ef3-46e6-83f6-131e192e9527', '2692b088-a260-4404-bdc7-723914147fe0', 'c095d21f-d792-49da-b85e-bc9dff95fef1', 'dd9e795e-9272-4dd0-b263-caa8075c8db5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:18 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:18 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-37a52170-28b3-4572-9a01-d9a8e5f58eef-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-37a52170-28b3-4572-9a01-d9a8e5f58eef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-quobyte-37a52170-28b3-4572-9a01-d9a8e5f58eef" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-37a52170-28b3-4572-9a01-d9a8e5f58eef" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae441026-3eed-4a0c-b3e2-6ef23c7dde11]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:18 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.460s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:18 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Deleted volume successfully. Sep 08 19:13:18 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef Sep 08 19:13:18 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d85ae52a-7da4-4242-a8b2-885b33f4e4c0 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-f6728cb6-3883-4a93-9b0a-c66e80f40028-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:18 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef" returned: 0 in 0.491s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:18 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef Sep 08 19:13:18 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:19 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37a52170-28b3-4572-9a01-d9a8e5f58eef" returned: 0 in 0.308s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-37a52170-28b3-4572-9a01-d9a8e5f58eef" released by "delete_volume" :: held 0.875s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created reservations ['140cbc16-f38e-425a-b950-8dbdd972c7e1', '314ab67f-52d0-4ad8-91e4-b8266a3c3476', '3ed3b5d3-bfb5-48e7-9233-825be78a2aa8', '07f9ec40-31a8-454c-9530-2f138c575ede'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:19 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:19 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-759af9b6-36c3-4727-b498-d8057b5b7940-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-759af9b6-36c3-4727-b498-d8057b5b7940-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-quobyte-759af9b6-36c3-4727-b498-d8057b5b7940" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-759af9b6-36c3-4727-b498-d8057b5b7940" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[320eea22-5539-436f-9833-617fc61aa462]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:20 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.571s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Deleted volume successfully. Sep 08 19:13:20 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 Sep 08 19:13:20 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-85d94d55-b308-4f66-95ad-b85aa1f96998 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-37a52170-28b3-4572-9a01-d9a8e5f58eef-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:20 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940" returned: 0 in 0.573s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:20 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940 Sep 08 19:13:20 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:20 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-759af9b6-36c3-4727-b498-d8057b5b7940" returned: 0 in 0.280s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-759af9b6-36c3-4727-b498-d8057b5b7940" released by "delete_volume" :: held 0.930s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=178,cinder:SELECT=140,cinder:INSERT=47,cinder:DELETE=22 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=130,cinder:INSERT=39,cinder:UPDATE=190,cinder:DELETE=11 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:13:20 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created reservations ['a70ad8dc-9fd8-4c73-a806-abb37d5e1ee2', 'cfb07096-3233-43a7-9f8f-eccd75f52c09', 'a40c41bb-149b-4ddd-b505-de313e0e4cb3', '7dc364bb-f3ad-4572-80cc-eb04b50ae781'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:21 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:21 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:21 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.359s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:21 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Deleted volume successfully. Sep 08 19:13:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f913ce79-afb0-4452-925d-95865c0cd451 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-759af9b6-36c3-4727-b498-d8057b5b7940-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-079ad202-d97f-4a0c-ae0e-f4f3387c443c-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-079ad202-d97f-4a0c-ae0e-f4f3387c443c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "cinder-quobyte-079ad202-d97f-4a0c-ae0e-f4f3387c443c" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-079ad202-d97f-4a0c-ae0e-f4f3387c443c" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1435f81-da63-4c8b-a3c5-136a4f09bba4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:22 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c Sep 08 19:13:22 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:22 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c" returned: 0 in 0.421s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:22 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c Sep 08 19:13:22 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:23 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-079ad202-d97f-4a0c-ae0e-f4f3387c443c" returned: 0 in 0.315s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-quobyte-079ad202-d97f-4a0c-ae0e-f4f3387c443c" released by "delete_volume" :: held 0.799s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Created reservations ['fcb728c9-662c-4e8d-9728-32274ff9d9c1', 'bc3734f7-439b-490d-89d4-21453beb8cd8', '3feb3261-5d71-40a3-a77e-e017b7739b05', '4b5d64ba-7de5-44a1-9db6-84a6bdf99149'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:23 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:23 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:23 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.380s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Deleted volume successfully. Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-620dd57a-d7cf-4ebc-925c-863056bb8c22 tempest-CreateVolumesFromSourceVolumeTest-1227230091 None] Lock "cinder-079ad202-d97f-4a0c-ae0e-f4f3387c443c-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Flow 'volume_create_manager' (12340fe1-f9b1-471b-8d90-f4447f563372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d65cc9-1a72-4c21-beef-98b0ab7e39d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d65cc9-1a72-4c21-beef-98b0ab7e39d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1560912620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d74739-212a-41f7-9cd1-9a05f8ceb0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0aaa72587642cf95ea7677f03cf285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:24Z,use_quota=True,user_id='df233122cde942e98c5bce2b134d6d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e2953-151c-4e25-a468-e9cb944c305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e2953-151c-4e25-a468-e9cb944c305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c04894-b231-4c5a-a63d-2b1990612fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c04894-b231-4c5a-a63d-2b1990612fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d74739-212a-41f7-9cd1-9a05f8ceb0d5', 'volume_name': 'volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165baba9-9ea0-404d-a7ac-ea952c48496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165baba9-9ea0-404d-a7ac-ea952c48496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aa09bb-8e76-4865-a5d4-e412db989eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:23 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Volume c7d74739-212a-41f7-9cd1-9a05f8ceb0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5', 'volume_size': 1} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1560912620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d74739-212a-41f7-9cd1-9a05f8ceb0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c0aaa72587642cf95ea7677f03cf285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:24Z,use_quota=True,user_id='df233122cde942e98c5bce2b134d6d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Creating volume c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:23 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:23 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 1073741824 Sep 08 19:13:23 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3a9befe6-e255-44aa-8d03-1f4b54d94d8a req-72a2385f-3637-4539-bbb9-5e34d999bf8b tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:24 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 1073741824" returned: 0 in 0.549s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:24 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 Sep 08 19:13:24 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:24 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5" returned: 0 in 0.278s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3a9befe6-e255-44aa-8d03-1f4b54d94d8a req-72a2385f-3637-4539-bbb9-5e34d999bf8b tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.837s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-3a9befe6-e255-44aa-8d03-1f4b54d94d8a req-72a2385f-3637-4539-bbb9-5e34d999bf8b tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aa09bb-8e76-4865-a5d4-e412db989eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94001fc5-c953-42d0-8c59-003b86ec6309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:24 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Volume volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 (c7d74739-212a-41f7-9cd1-9a05f8ceb0d5): created successfully Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94001fc5-c953-42d0-8c59-003b86ec6309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Flow 'volume_create_manager' (12340fe1-f9b1-471b-8d90-f4447f563372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-98d84770-abe1-4e7c-b4d3-0c3b68f1d5b9 tempest-VolumesMetadataTest-668084470 None] Created volume successfully. Sep 08 19:13:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-3a9befe6-e255-44aa-8d03-1f4b54d94d8a req-72a2385f-3637-4539-bbb9-5e34d999bf8b tempest-TestServerVolumeAttachmentScenario-165747812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-083aeedc-98b9-48eb-a5d3-86a48fc74912', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25cf44a8-4b0d-491d-a5cf-13389015fce5', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:13:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-3a9befe6-e255-44aa-8d03-1f4b54d94d8a req-72a2385f-3637-4539-bbb9-5e34d999bf8b tempest-TestServerVolumeAttachmentScenario-165747812 None] attachment_update completed successfully. Sep 08 19:13:26 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Flow 'volume_create_manager' (3a6929b6-3445-4842-a4f4-2d99dca1f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804f4c65-963a-49eb-a6cd-7134bcf1cb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804f4c65-963a-49eb-a6cd-7134bcf1cb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555535c1-ae01-4d4d-9687-f6f3784d7909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b595489a4ae2465aa92e64156047f74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:27Z,use_quota=True,user_id='7c3a0bbdb9e040148dba2db0f3e0cf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931cdd29-d9d6-4008-9b98-84e95ee16870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931cdd29-d9d6-4008-9b98-84e95ee16870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b83b527-1df3-42f3-a158-11c569532f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b83b527-1df3-42f3-a158-11c569532f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555535c1-ae01-4d4d-9687-f6f3784d7909', 'volume_name': 'volume-555535c1-ae01-4d4d-9687-f6f3784d7909', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a37f95-2a54-457f-89c3-75303f8a8d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a37f95-2a54-457f-89c3-75303f8a8d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c500caf-e214-44b7-9b9f-5e596431d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Volume 555535c1-ae01-4d4d-9687-f6f3784d7909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555535c1-ae01-4d4d-9687-f6f3784d7909', 'volume_size': 1} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555535c1-ae01-4d4d-9687-f6f3784d7909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b595489a4ae2465aa92e64156047f74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:27Z,use_quota=True,user_id='7c3a0bbdb9e040148dba2db0f3e0cf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Creating volume 555535c1-ae01-4d4d-9687-f6f3784d7909 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:27 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:27 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 1073741824 Sep 08 19:13:27 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Acquiring lock "cinder-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Lock "cinder-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Acquiring lock "cinder-quobyte-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Lock "cinder-quobyte-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[136164c0-5326-40c0-917e-59fd2cdc588f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:27 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 Sep 08 19:13:27 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:27 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 1073741824" returned: 0 in 0.553s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:27 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 Sep 08 19:13:27 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-8b61052b-de1c-45d3-a193-f3a067a62a59 req-e4f65cca-be66-4861-bad2-626b9745919e tempest-TestServerVolumeAttachmentScenario-165747812 None] Terminate volume connection completed successfully. Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-8b61052b-de1c-45d3-a193-f3a067a62a59 req-e4f65cca-be66-4861-bad2-626b9745919e tempest-TestServerVolumeAttachmentScenario-165747812 None] Deleting attachment 25cf44a8-4b0d-491d-a5cf-13389015fce5. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:13:27 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5" returned: 0 in 0.470s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:27 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5 Sep 08 19:13:27 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:28 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909" returned: 0 in 0.341s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c500caf-e214-44b7-9b9f-5e596431d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555535c1-ae01-4d4d-9687-f6f3784d7909', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4b9dc-109d-47cc-9d1e-636a5686ed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Volume volume-555535c1-ae01-4d4d-9687-f6f3784d7909 (555535c1-ae01-4d4d-9687-f6f3784d7909): created successfully Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4b9dc-109d-47cc-9d1e-636a5686ed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Flow 'volume_create_manager' (3a6929b6-3445-4842-a4f4-2d99dca1f24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-31b57a0d-4585-4342-8012-c96d961a5eed tempest-CinderUnicodeTest-1554715928 None] Created volume successfully. Sep 08 19:13:28 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5" returned: 0 in 0.355s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Lock "cinder-quobyte-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5" released by "delete_volume" :: held 0.880s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Created reservations ['3e7bcb73-734f-4208-b9a9-a11e8bc5b79d', '62fd6bad-b1b9-4aa5-beac-73f71af28f86', '6ec1dc83-77cc-4be7-af0f-5fa247880667', 'ac497690-07f2-4f5f-8e6f-7e31048d85c3'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:28 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:28 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:28 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.281s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Deleted volume successfully. Sep 08 19:13:28 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0b97c867-f953-40a4-84ea-8b67e956c3e2 tempest-VolumesMetadataTest-668084470 None] Lock "cinder-c7d74739-212a-41f7-9cd1-9a05f8ceb0d5-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-fe651c28-739a-4c0f-891c-04677ff4e0a8 req-8c866acc-9f1e-4358-a7f9-dae4272504dd tempest-TestServerVolumeAttachmentScenario-165747812 None] Terminate volume connection completed successfully. Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-fe651c28-739a-4c0f-891c-04677ff4e0a8 req-8c866acc-9f1e-4358-a7f9-dae4272504dd tempest-TestServerVolumeAttachmentScenario-165747812 None] Deleting attachment 86117ac9-29d5-4c7c-a0b0-b9aad40305d4. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Flow 'volume_create_manager' (6e40e723-c27c-438b-9f7d-48ebf6608140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6e4616-223f-4810-aba7-6f696563da4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6e4616-223f-4810-aba7-6f696563da4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-449942174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9d2286-9a65-443d-9207-65a08bd33374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b595489a4ae2465aa92e64156047f74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:30Z,use_quota=True,user_id='7c3a0bbdb9e040148dba2db0f3e0cf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755790f2-a7cd-4568-94a7-b20007c28c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755790f2-a7cd-4568-94a7-b20007c28c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e24935-c1dc-475b-94b0-8056de4391c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e24935-c1dc-475b-94b0-8056de4391c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c9d2286-9a65-443d-9207-65a08bd33374', 'volume_name': 'volume-6c9d2286-9a65-443d-9207-65a08bd33374', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5435ec81-1564-483c-8da9-74debf683b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5435ec81-1564-483c-8da9-74debf683b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60272ec1-bd30-4105-bb45-ad23a0ff1d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:29 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Volume 6c9d2286-9a65-443d-9207-65a08bd33374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c9d2286-9a65-443d-9207-65a08bd33374', 'volume_size': 1} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-449942174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9d2286-9a65-443d-9207-65a08bd33374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b595489a4ae2465aa92e64156047f74b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:30Z,use_quota=True,user_id='7c3a0bbdb9e040148dba2db0f3e0cf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Creating volume 6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:29 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:30 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 1073741824 Sep 08 19:13:30 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:30 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 1073741824" returned: 0 in 0.577s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:30 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 Sep 08 19:13:30 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:31 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374" returned: 0 in 0.499s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60272ec1-bd30-4105-bb45-ad23a0ff1d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9d2286-9a65-443d-9207-65a08bd33374', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6285b424-7e1e-4563-b93c-8a574ff3fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Volume volume-6c9d2286-9a65-443d-9207-65a08bd33374 (6c9d2286-9a65-443d-9207-65a08bd33374): created successfully Sep 08 19:13:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6285b424-7e1e-4563-b93c-8a574ff3fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Flow 'volume_create_manager' (6e40e723-c27c-438b-9f7d-48ebf6608140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f44cdcfa-8cf0-4d4f-ad9d-d0daaf7c24cc tempest-CinderUnicodeTest-1554715928 None] Created volume successfully. Sep 08 19:13:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Creating offline snapshot 859d9e9c-126a-46b8-b974-645006a1da4c of volume 6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:13:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa955ca-5e58-416a-94f1-4363cb06cbdd]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:32 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 Sep 08 19:13:32 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:32 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374" returned: 0 in 0.466s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:32 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c 1G Sep 08 19:13:32 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:33 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c 1G" returned: 0 in 0.538s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c9d2286-9a65-443d-9207-65a08bd33374 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:33 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c9d2286-9a65-443d-9207-65a08bd33374 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c Sep 08 19:13:33 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:33 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c9d2286-9a65-443d-9207-65a08bd33374 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c" returned: 0 in 0.353s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:33 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c is being set with open permissions: ugo+rw Sep 08 19:13:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:33 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c Sep 08 19:13:33 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:33 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:34 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.info Sep 08 19:13:34 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:34 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.info" returned: 0 in 0.278s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:34 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.info is being set with open permissions: ugo+rw Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:34 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.info Sep 08 19:13:34 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "cinder-083aeedc-98b9-48eb-a5d3-86a48fc74912-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-083aeedc-98b9-48eb-a5d3-86a48fc74912-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:34 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:34 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "cinder-quobyte-083aeedc-98b9-48eb-a5d3-86a48fc74912" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-quobyte-083aeedc-98b9-48eb-a5d3-86a48fc74912" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bb0b82-026f-41df-aa5b-7da2478c0038]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:34 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 Sep 08 19:13:34 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:34 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.info" returned: 0 in 0.369s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:34 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.334s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:13:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c3909a04-6af4-4b51-a92d-70163377cf4b tempest-CinderUnicodeTest-1554715928 None] Create snapshot completed successfully Sep 08 19:13:34 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912" returned: 0 in 0.447s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:35 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912 Sep 08 19:13:35 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Flow 'volume_create_manager' (cc80e5a3-c0ed-4501-8b1e-7d64b5cd0858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cb89dd-e134-4cbd-83d4-eab069ffcb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3cb89dd-e134-4cbd-83d4-eab069ffcb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-375292542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff04ff6d-d123-430b-b976-caaf58f5ee09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfe8eb5ff414a2e80ccb406543b6f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:35Z,use_quota=True,user_id='ef0da263a8654cf290e4d482d6fa94cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72db7028-08f0-4a78-8820-c6c34a61c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72db7028-08f0-4a78-8820-c6c34a61c674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954ef339-29e5-440b-9ba5-f5d6a9fff3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954ef339-29e5-440b-9ba5-f5d6a9fff3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff04ff6d-d123-430b-b976-caaf58f5ee09', 'volume_name': 'volume-ff04ff6d-d123-430b-b976-caaf58f5ee09', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2c7a0a-a888-4c50-9a02-cbdf7e191d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2c7a0a-a888-4c50-9a02-cbdf7e191d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c50388-4330-4494-980d-457452c8ced4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Volume ff04ff6d-d123-430b-b976-caaf58f5ee09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff04ff6d-d123-430b-b976-caaf58f5ee09', 'volume_size': 1} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-375292542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff04ff6d-d123-430b-b976-caaf58f5ee09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfe8eb5ff414a2e80ccb406543b6f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:35Z,use_quota=True,user_id='ef0da263a8654cf290e4d482d6fa94cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Creating volume ff04ff6d-d123-430b-b976-caaf58f5ee09 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:35 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:35 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 1073741824 Sep 08 19:13:35 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:35 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-083aeedc-98b9-48eb-a5d3-86a48fc74912" returned: 0 in 0.261s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-quobyte-083aeedc-98b9-48eb-a5d3-86a48fc74912" released by "delete_volume" :: held 0.757s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Created reservations ['93391747-8573-4bd4-bb3f-f1450a43f1cd', 'ee525d57-2e12-44bb-b328-300a33e0c9cf', '5c0d476f-7f23-43b3-9ae0-3061fa5161b1', '141a1223-87b2-4dff-9b99-d5d173b6ac08'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:35 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:35 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "cinder-859d9e9c-126a-46b8-b974-645006a1da4c-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-859d9e9c-126a-46b8-b974-645006a1da4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "cinder-quobyte-6c9d2286-9a65-443d-9207-65a08bd33374" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "cinder-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-6c9d2286-9a65-443d-9207-65a08bd33374" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "cinder-quobyte-859d9e9c-126a-46b8-b974-645006a1da4c" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:35 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.298s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-859d9e9c-126a-46b8-b974-645006a1da4c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Deleting offline snapshot 859d9e9c-126a-46b8-b974-645006a1da4c of volume 6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] snapshot_file for this snap is: volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Deleted volume successfully. Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f181360-a8c7-4fca-9ca0-26868fa78b22]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:35 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 1073741824" returned: 0 in 0.560s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-33063551-64d3-4c4b-a642-d5c33659ad21 tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-083aeedc-98b9-48eb-a5d3-86a48fc74912-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "cinder-quobyte-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-quobyte-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:35 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 Sep 08 19:13:35 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f951e44-5de4-4300-8fbe-bb4a7655bc25]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:35 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c Sep 08 19:13:35 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:35 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f Sep 08 19:13:35 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:36 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c50388-4330-4494-980d-457452c8ced4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff04ff6d-d123-430b-b976-caaf58f5ee09', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d76baf-acf6-4e2d-8605-6d78dec21015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Volume volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 (ff04ff6d-d123-430b-b976-caaf58f5ee09): created successfully Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d76baf-acf6-4e2d-8605-6d78dec21015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:36 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Flow 'volume_create_manager' (cc80e5a3-c0ed-4501-8b1e-7d64b5cd0858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c" returned: 0 in 0.444s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c9d2286-9a65-443d-9207-65a08bd33374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:13:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4611ee4b-8650-4a2d-a7c6-5dc9cb2a2511 tempest-VolumesTransfersV357Test-892418418 None] Created volume successfully. Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[151f437e-227f-4d33-9efb-e14f202bf30c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:36 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:36 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f Sep 08 19:13:36 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:36 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 Sep 08 19:13:36 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:36 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f" returned: 0 in 0.254s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-quobyte-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f" released by "delete_volume" :: held 0.705s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Created reservations ['98729252-7847-48e2-bbd7-84162e719329', '48591286-1ea0-4466-878e-b1bf7240d8f5', '1fdf6539-664c-438d-bbf8-99374b7fb3f2', '5ca6637a-eb36-46fa-bbff-73cf4368cfee'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:36 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374" returned: 0 in 0.400s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:36 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c Sep 08 19:13:36 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:36 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:36 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:36 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.278s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Deleted volume successfully. Sep 08 19:13:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a1569076-4331-40a6-add5-98169370b27a tempest-TestServerVolumeAttachmentScenario-165747812 None] Lock "cinder-d2d12e47-c0c8-47c3-9e2c-42b2fcafe64f-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:37 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:37 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c Sep 08 19:13:37 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:37 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374.859d9e9c-126a-46b8-b974-645006a1da4c" returned: 0 in 0.271s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-859d9e9c-126a-46b8-b974-645006a1da4c" released by "_delete_snapshot" :: held 1.654s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-6c9d2286-9a65-443d-9207-65a08bd33374" released by "delete_snapshot" :: held 1.694s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Created reservations ['79521df4-da4d-4e95-bb08-a9793dabdfd6', 'b0456fbd-a198-4ff3-80b0-f1db0eadb8ad', 'd4349b2f-60bb-4977-b5f4-28ae088bc122', 'a2ba67f8-6160-4a03-8f73-5d25a4835298'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Delete snapshot completed successfully. Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-69799fdd-935d-4427-80b7-2712fb9fa5db tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-859d9e9c-126a-46b8-b974-645006a1da4c-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "cinder-6c9d2286-9a65-443d-9207-65a08bd33374-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-6c9d2286-9a65-443d-9207-65a08bd33374-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "cinder-quobyte-6c9d2286-9a65-443d-9207-65a08bd33374" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-6c9d2286-9a65-443d-9207-65a08bd33374" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[22684074-228a-46fe-a8d0-518c408e0c0c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-93ee06da-ea80-467a-8137-d18d5768728b tempest-VolumesTransfersV357Test-821143676 None] Transfer volume completed successfully. Sep 08 19:13:38 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 Sep 08 19:13:38 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:38 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374" returned: 0 in 0.431s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:38 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374 Sep 08 19:13:38 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Acquiring lock "cinder-ff04ff6d-d123-430b-b976-caaf58f5ee09-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-ff04ff6d-d123-430b-b976-caaf58f5ee09-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Acquiring lock "cinder-quobyte-ff04ff6d-d123-430b-b976-caaf58f5ee09" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-quobyte-ff04ff6d-d123-430b-b976-caaf58f5ee09" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[29166a3e-c6c8-4dd2-bca3-9ec91658a25f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:38 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6c9d2286-9a65-443d-9207-65a08bd33374" returned: 0 in 0.344s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-6c9d2286-9a65-443d-9207-65a08bd33374" released by "delete_volume" :: held 0.862s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Created reservations ['3092d162-a322-453d-9dac-cf02626a9083', '87b7047e-cd8f-43e0-a3ec-194e3d17b007', 'aeefa9bd-5904-4cb0-b4e8-fa0258ee4e70', 'fb1bebda-e3bd-4ce5-927b-1e35492a112d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:38 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 Sep 08 19:13:38 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:38 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:38 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "cinder-555535c1-ae01-4d4d-9687-f6f3784d7909-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-555535c1-ae01-4d4d-9687-f6f3784d7909-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "cinder-quobyte-555535c1-ae01-4d4d-9687-f6f3784d7909" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-555535c1-ae01-4d4d-9687-f6f3784d7909" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6264bd-77cf-4098-b010-8154448507d5]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:39 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09" returned: 0 in 0.469s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:39 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:39 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09 Sep 08 19:13:39 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Deleted volume successfully. Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7d44bb6d-fe78-4b68-a905-551e7d07de2b tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-6c9d2286-9a65-443d-9207-65a08bd33374-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:39 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 Sep 08 19:13:39 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:39 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ff04ff6d-d123-430b-b976-caaf58f5ee09" returned: 0 in 0.271s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-quobyte-ff04ff6d-d123-430b-b976-caaf58f5ee09" released by "delete_volume" :: held 0.786s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Created reservations ['7e03a81b-01ed-4d84-a252-ec1da25c3882', '609634cb-5793-4a7d-b88d-27c98489c4f2', 'a14e9eeb-be4a-49a7-88bc-b80208d67e87', 'f09d4fcb-afd8-4413-9586-674571df3a1b'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:39 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909" returned: 0 in 0.432s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:39 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909 Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:39 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:39 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:39 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:39 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-555535c1-ae01-4d4d-9687-f6f3784d7909" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:39 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-quobyte-555535c1-ae01-4d4d-9687-f6f3784d7909" released by "delete_volume" :: held 0.794s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.301s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Deleted volume successfully. Sep 08 19:13:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-58cb908d-e2e3-4551-9aeb-c7a6a807de67 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-ff04ff6d-d123-430b-b976-caaf58f5ee09-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Created reservations ['20490e37-6389-4622-9919-17b82ab4b0f1', '85475781-a021-4a52-9f8d-b30389e8f33b', '9329f5ed-bd7e-4a86-ab98-0900a70a34d3', '9734ff66-79ed-4b14-93d8-ed8658de5af6'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:40 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:40 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:40 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.284s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Deleted volume successfully. Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Flow 'volume_create_manager' (845c311c-878c-4ee3-a8fb-7cd0c48214a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de68aac0-8129-4cdc-9a64-7e52d3f11d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-782dfafd-0ac7-4f26-865d-bb7e46724a59 tempest-CinderUnicodeTest-1554715928 None] Lock "cinder-555535c1-ae01-4d4d-9687-f6f3784d7909-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de68aac0-8129-4cdc-9a64-7e52d3f11d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1375024983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24d89e1-7e91-4f8d-a47a-a632e48ce87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfe8eb5ff414a2e80ccb406543b6f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:40Z,use_quota=True,user_id='ef0da263a8654cf290e4d482d6fa94cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94d01de-f5ef-407e-8850-6fbaea50515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94d01de-f5ef-407e-8850-6fbaea50515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baff0bec-6f97-46e2-bce0-b369f348a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baff0bec-6f97-46e2-bce0-b369f348a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24d89e1-7e91-4f8d-a47a-a632e48ce87a', 'volume_name': 'volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbb1e6c-72a6-4edf-a9b4-a3ba56b86492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbb1e6c-72a6-4edf-a9b4-a3ba56b86492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774a2cd3-31b2-4757-b9ce-1b5066095386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Volume b24d89e1-7e91-4f8d-a47a-a632e48ce87a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a', 'volume_size': 1} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1375024983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24d89e1-7e91-4f8d-a47a-a632e48ce87a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfe8eb5ff414a2e80ccb406543b6f5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:40Z,use_quota=True,user_id='ef0da263a8654cf290e4d482d6fa94cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Creating volume b24d89e1-7e91-4f8d-a47a-a632e48ce87a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:40 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:40 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a 1073741824 Sep 08 19:13:40 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:41 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a 1073741824" returned: 0 in 0.618s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:41 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a Sep 08 19:13:41 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:41 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a" returned: 0 in 0.346s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774a2cd3-31b2-4757-b9ce-1b5066095386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ba683f-9160-4ef5-82c0-ca301928136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:41 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Volume volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a (b24d89e1-7e91-4f8d-a47a-a632e48ce87a): created successfully Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ba683f-9160-4ef5-82c0-ca301928136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:41 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Flow 'volume_create_manager' (845c311c-878c-4ee3-a8fb-7cd0c48214a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-46e7cdf3-8298-405f-b30b-2c7aa1873766 tempest-VolumesTransfersV357Test-892418418 None] Created volume successfully. Sep 08 19:13:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Acquiring lock "cinder-b24d89e1-7e91-4f8d-a47a-a632e48ce87a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-b24d89e1-7e91-4f8d-a47a-a632e48ce87a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Acquiring lock "cinder-quobyte-b24d89e1-7e91-4f8d-a47a-a632e48ce87a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-quobyte-b24d89e1-7e91-4f8d-a47a-a632e48ce87a" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fb0c28-0c8d-4f78-8c1f-381e27d8c553]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:43 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a Sep 08 19:13:43 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:43 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a" returned: 0 in 0.413s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:43 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a Sep 08 19:13:43 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:43 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b24d89e1-7e91-4f8d-a47a-a632e48ce87a" returned: 0 in 0.290s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-quobyte-b24d89e1-7e91-4f8d-a47a-a632e48ce87a" released by "delete_volume" :: held 0.762s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Created reservations ['9a204541-2bc7-49b3-8afa-4c46e9ed84be', '3432b795-a1a1-426d-8e9f-41e2762353d9', '2cffd177-90fb-41e2-a79a-49259aa590a7', 'fe08761f-bfdb-463e-ae4a-e533a45f5491'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:43 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:43 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:44 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.289s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Deleted volume successfully. Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-838ecff7-7b02-46f8-ac19-5832f0714238 tempest-VolumesTransfersV357Test-1850211506 None] Lock "cinder-b24d89e1-7e91-4f8d-a47a-a632e48ce87a-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (5f39b1eb-0e3c-4496-b50c-4d970086c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4bf49e-9ed3-4cb3-bed2-0bf2471bd6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4bf49e-9ed3-4cb3-bed2-0bf2471bd6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901296556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2356634a-cf38-4299-8839-3c4c0922e6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:45Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2424c845-71fb-4453-b2e0-ff14c2ffd41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2424c845-71fb-4453-b2e0-ff14c2ffd41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509cd47f-1b9d-4262-8341-00e0b032304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509cd47f-1b9d-4262-8341-00e0b032304e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2356634a-cf38-4299-8839-3c4c0922e6a0', 'volume_name': 'volume-2356634a-cf38-4299-8839-3c4c0922e6a0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d4a52b-f17b-498a-954d-41e76bc614e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d4a52b-f17b-498a-954d-41e76bc614e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4af084c-bdfa-496a-b378-6b440c0010f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:44 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Volume 2356634a-cf38-4299-8839-3c4c0922e6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2356634a-cf38-4299-8839-3c4c0922e6a0', 'volume_size': 1} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901296556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2356634a-cf38-4299-8839-3c4c0922e6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:45Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Creating volume 2356634a-cf38-4299-8839-3c4c0922e6a0 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:44 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:44 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 1073741824 Sep 08 19:13:44 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:45 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 1073741824" returned: 0 in 0.472s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:45 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 Sep 08 19:13:45 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:45 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0" returned: 0 in 0.281s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4af084c-bdfa-496a-b378-6b440c0010f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2356634a-cf38-4299-8839-3c4c0922e6a0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c2ad78-508b-4301-bc1f-5df8b44b8dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:45 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Volume volume-2356634a-cf38-4299-8839-3c4c0922e6a0 (2356634a-cf38-4299-8839-3c4c0922e6a0): created successfully Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c2ad78-508b-4301-bc1f-5df8b44b8dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (5f39b1eb-0e3c-4496-b50c-4d970086c489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-45f38d01-cd2d-4312-b20e-5f1586dc759f tempest-ProjectReaderTests-1590470011 None] Created volume successfully. Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-2356634a-cf38-4299-8839-3c4c0922e6a0-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-2356634a-cf38-4299-8839-3c4c0922e6a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-quobyte-2356634a-cf38-4299-8839-3c4c0922e6a0" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-2356634a-cf38-4299-8839-3c4c0922e6a0" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62dfa5f-c527-4716-82e6-d75a4dc9fc31]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:47 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 Sep 08 19:13:47 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:47 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0" returned: 0 in 0.455s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:47 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0 Sep 08 19:13:47 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:47 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2356634a-cf38-4299-8839-3c4c0922e6a0" returned: 0 in 0.267s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-2356634a-cf38-4299-8839-3c4c0922e6a0" released by "delete_volume" :: held 0.788s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Created reservations ['8928148c-6062-44f9-aee0-ad209ef112aa', '8ef51279-c646-4206-8092-e583dfe2468e', 'f42e796d-58fc-43ec-9b58-744cc7793434', '82ba3843-fafb-4937-b425-49ecd49c6461'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:48 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:48 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:48 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.307s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Deleted volume successfully. Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3233b2c5-6895-4c15-a0be-dc7abd82ac73 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-2356634a-cf38-4299-8839-3c4c0922e6a0-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (1e461740-f7e1-4b57-9d43-7e3937a962be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8299f4c-eea5-4ef4-8732-577c9fc112ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8299f4c-eea5-4ef4-8732-577c9fc112ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512163647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8237062-e19d-41f1-ad6e-1b9ef992c105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:49Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a96664-d8a5-4ff2-91d0-e80ef7e71844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a96664-d8a5-4ff2-91d0-e80ef7e71844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e99bcc-a45a-4ba7-94a6-0a7d32e6f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e99bcc-a45a-4ba7-94a6-0a7d32e6f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8237062-e19d-41f1-ad6e-1b9ef992c105', 'volume_name': 'volume-d8237062-e19d-41f1-ad6e-1b9ef992c105', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e859abe-d33a-453d-9480-54a59b8ab0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e859abe-d33a-453d-9480-54a59b8ab0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8547157-b053-4d24-8598-0e1dc6a7402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Volume d8237062-e19d-41f1-ad6e-1b9ef992c105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8237062-e19d-41f1-ad6e-1b9ef992c105', 'volume_size': 1} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-512163647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8237062-e19d-41f1-ad6e-1b9ef992c105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:49Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Creating volume d8237062-e19d-41f1-ad6e-1b9ef992c105 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:49 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:49 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 1073741824 Sep 08 19:13:49 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:49 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 1073741824" returned: 0 in 0.462s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:49 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 Sep 08 19:13:49 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:49 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8547157-b053-4d24-8598-0e1dc6a7402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8237062-e19d-41f1-ad6e-1b9ef992c105', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3864eb91-4b50-4d13-97d8-374be5046938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Volume volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 (d8237062-e19d-41f1-ad6e-1b9ef992c105): created successfully Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3864eb91-4b50-4d13-97d8-374be5046938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (1e461740-f7e1-4b57-9d43-7e3937a962be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f1d205f8-b865-4975-8e40-44e0ebd86ff8 tempest-ProjectReaderTests-1590470011 None] Created volume successfully. Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-d8237062-e19d-41f1-ad6e-1b9ef992c105-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Lock "cinder-d8237062-e19d-41f1-ad6e-1b9ef992c105-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-quobyte-d8237062-e19d-41f1-ad6e-1b9ef992c105" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-d8237062-e19d-41f1-ad6e-1b9ef992c105" acquired by "delete_volume" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf83170-e867-4622-9c86-734cfdc84a8a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:51 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 Sep 08 19:13:51 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:51 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105" returned: 0 in 0.464s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:51 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105 Sep 08 19:13:51 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:52 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d8237062-e19d-41f1-ad6e-1b9ef992c105" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-d8237062-e19d-41f1-ad6e-1b9ef992c105" released by "delete_volume" :: held 0.832s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Created reservations ['3a79b466-b6e9-4f48-bf71-1e6c944e5d7d', '4558c8ce-264e-430c-a049-c510bf0fd8c4', 'a03ba3ed-0e1a-475b-b552-6c0cbc8c3651', '9084d6fa-9c61-4d07-a7e1-b66f8989a0e6'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:52 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:52 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:52 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Deleted volume successfully. Sep 08 19:13:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4d0319c2-1468-4496-83f5-d984e527545f tempest-ProjectReaderTests-1590470011 None] Lock "cinder-d8237062-e19d-41f1-ad6e-1b9ef992c105-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (9e9c72ec-a531-46a7-919e-220673893970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54be6de-df1f-40d9-b2d7-5f879fdf4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54be6de-df1f-40d9-b2d7-5f879fdf4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427332652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a444b1dc-62bb-4e73-8f21-546d87e55b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:53Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6011699-8d3e-438e-afbc-f52b5c50667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6011699-8d3e-438e-afbc-f52b5c50667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5b5e08-876c-4a7d-b828-f3838c94a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5b5e08-876c-4a7d-b828-f3838c94a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a444b1dc-62bb-4e73-8f21-546d87e55b2a', 'volume_name': 'volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d7b120-fcca-412f-8064-f42e962d2f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d7b120-fcca-412f-8064-f42e962d2f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b611b66-a971-4f0d-be8b-7f64d529bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Volume a444b1dc-62bb-4e73-8f21-546d87e55b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a', 'volume_size': 1} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427332652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a444b1dc-62bb-4e73-8f21-546d87e55b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:53Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Creating volume a444b1dc-62bb-4e73-8f21-546d87e55b2a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:53 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:53 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a 1073741824 Sep 08 19:13:53 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:53 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a 1073741824" returned: 0 in 0.481s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:53 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a Sep 08 19:13:53 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:54 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a" returned: 0 in 0.288s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b611b66-a971-4f0d-be8b-7f64d529bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211c374d-41d2-4709-8a9b-ccdab03b41b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:54 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Volume volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a (a444b1dc-62bb-4e73-8f21-546d87e55b2a): created successfully Sep 08 19:13:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211c374d-41d2-4709-8a9b-ccdab03b41b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (9e9c72ec-a531-46a7-919e-220673893970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:54 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1397773a-02dc-43f4-a3af-761422e65293 tempest-ProjectReaderTests-1590470011 None] Created volume successfully. Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-a444b1dc-62bb-4e73-8f21-546d87e55b2a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Lock "cinder-a444b1dc-62bb-4e73-8f21-546d87e55b2a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-quobyte-a444b1dc-62bb-4e73-8f21-546d87e55b2a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-a444b1dc-62bb-4e73-8f21-546d87e55b2a" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c410b17-feed-487b-86d8-623959523a12]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:55 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a Sep 08 19:13:55 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:55 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a" returned: 0 in 0.493s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:55 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a Sep 08 19:13:55 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:56 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a444b1dc-62bb-4e73-8f21-546d87e55b2a" returned: 0 in 0.319s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-a444b1dc-62bb-4e73-8f21-546d87e55b2a" released by "delete_volume" :: held 0.862s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Created reservations ['e3ac23ed-7bee-4ca4-9dae-0c0b5a22cf24', '8ac2ef15-56f0-48be-88c7-1e8d18850b26', 'fe02cb52-ab48-4b7b-b0a5-e2ef8263e448', '036b4832-bcea-4809-a732-74be823a96ff'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:56 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:13:56 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:56 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Deleted volume successfully. Sep 08 19:13:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-910baf9e-9675-4f47-94dd-f2cfe9b9dccf tempest-ProjectReaderTests-1590470011 None] Lock "cinder-a444b1dc-62bb-4e73-8f21-546d87e55b2a-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (1aee588d-8372-400f-8b60-3f4eca417d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347a6334-1fd5-40a0-b0cb-5b70aa648e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347a6334-1fd5-40a0-b0cb-5b70aa648e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580922546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97437e5-e8cc-412e-b9c2-ab172693a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:57Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ef37b6-221e-430b-a208-46ccba40ed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ef37b6-221e-430b-a208-46ccba40ed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d3b2c-bb06-46bc-ab86-28d9758ebfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d3b2c-bb06-46bc-ab86-28d9758ebfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97437e5-e8cc-412e-b9c2-ab172693a9f6', 'volume_name': 'volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459d382e-5771-4eac-950e-9e906d074c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459d382e-5771-4eac-950e-9e906d074c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a28e17e-f15e-42a9-bb59-3f8d975ac497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:57 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Volume c97437e5-e8cc-412e-b9c2-ab172693a9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6', 'volume_size': 1} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580922546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97437e5-e8cc-412e-b9c2-ab172693a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fc28b4e0eb04965bf2707cd4fdfe6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:13:57Z,use_quota=True,user_id='badff1ecfeac4a7ba60322806bba4a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Creating volume c97437e5-e8cc-412e-b9c2-ab172693a9f6 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:13:57 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:57 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 1073741824 Sep 08 19:13:57 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:57 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 1073741824" returned: 0 in 0.527s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:57 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 Sep 08 19:13:57 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:58 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6" returned: 0 in 0.310s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:13:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a28e17e-f15e-42a9-bb59-3f8d975ac497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c30b35-d8bf-4614-baf6-0094bd2518be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:13:58 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Volume volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 (c97437e5-e8cc-412e-b9c2-ab172693a9f6): created successfully Sep 08 19:13:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c30b35-d8bf-4614-baf6-0094bd2518be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:13:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Flow 'volume_create_manager' (1aee588d-8372-400f-8b60-3f4eca417d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:13:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e6e93352-9a03-4484-bd88-a6c94bd2ae4e tempest-ProjectReaderTests-1590470011 None] Created volume successfully. Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-c97437e5-e8cc-412e-b9c2-ab172693a9f6-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-c97437e5-e8cc-412e-b9c2-ab172693a9f6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "cinder-quobyte-c97437e5-e8cc-412e-b9c2-ab172693a9f6" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-c97437e5-e8cc-412e-b9c2-ab172693a9f6" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f8bf5-e0d2-4c9f-bd01-dc1250602514]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:59 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 Sep 08 19:13:59 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:59 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6" returned: 0 in 0.406s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:59 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6 Sep 08 19:13:59 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:00 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97437e5-e8cc-412e-b9c2-ab172693a9f6" returned: 0 in 0.332s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-quobyte-c97437e5-e8cc-412e-b9c2-ab172693a9f6" released by "delete_volume" :: held 0.801s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Created reservations ['18e3c1d0-b430-4c8a-bce7-31e1d5aeb464', '901a2bb0-6e3d-4e26-827c-c7a09f128c93', '85e5330c-4194-4220-82b0-4fcb2f67c207', '0053ffc3-b5c2-41cc-afc8-64b9c9e9b070'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:00 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:14:00 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:00 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.358s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:14:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Deleted volume successfully. Sep 08 19:14:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-302b9277-1947-485c-b4c9-a624af312f19 tempest-ProjectReaderTests-1590470011 None] Lock "cinder-c97437e5-e8cc-412e-b9c2-ab172693a9f6-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Flow 'volume_create_manager' (822fc2c3-d8a4-4fcd-aa62-54602a5f456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4981f2-67e5-4913-8852-306af824cefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4981f2-67e5-4913-8852-306af824cefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901283822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd70fa16-2151-4e2c-a0e5-df2718223ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798a646cf3f94886b526a5ba40814f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:14:06Z,use_quota=True,user_id='ffbefee7419f440995cb50718d3b5b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369f15ff-8302-448c-9c32-48007f35a7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369f15ff-8302-448c-9c32-48007f35a7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6033ae88-900a-4db4-9a76-cc41fafc92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6033ae88-900a-4db4-9a76-cc41fafc92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd70fa16-2151-4e2c-a0e5-df2718223ac9', 'volume_name': 'volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72177df-61c9-4c09-99ba-28bbce659f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72177df-61c9-4c09-99ba-28bbce659f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ca4704-7a3b-4a1b-b6ff-7ac06b83383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:06 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Volume cd70fa16-2151-4e2c-a0e5-df2718223ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9', 'volume_size': 1} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-901283822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd70fa16-2151-4e2c-a0e5-df2718223ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='798a646cf3f94886b526a5ba40814f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:14:06Z,use_quota=True,user_id='ffbefee7419f440995cb50718d3b5b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Creating volume cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:14:06 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:06 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 1073741824 Sep 08 19:14:06 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:06 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 1073741824" returned: 0 in 0.551s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:06 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:14:06 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:06 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.285s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:14:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ca4704-7a3b-4a1b-b6ff-7ac06b83383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b8ce85-acd0-4a5c-af15-c0a8edada972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:07 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Volume volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 (cd70fa16-2151-4e2c-a0e5-df2718223ac9): created successfully Sep 08 19:14:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b8ce85-acd0-4a5c-af15-c0a8edada972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Flow 'volume_create_manager' (822fc2c3-d8a4-4fcd-aa62-54602a5f456d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:14:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-16af99c5-7c06-4913-8548-181280f1e13b tempest-VolumesActionsTest-1885245278 None] Created volume successfully. Sep 08 19:14:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cef7a309-eff4-49ae-8eb6-47238dcc3410 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9" by "attach_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:14:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cef7a309-eff4-49ae-8eb6-47238dcc3410 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9" acquired by "attach_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:14:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-cef7a309-eff4-49ae-8eb6-47238dcc3410 tempest-VolumesActionsTest-1885245278 None] Attaching volume cd70fa16-2151-4e2c-a0e5-df2718223ac9 to instance ac46476e-97a2-4c46-9ba6-94fb1e69b8bd at mountpoint /dev/vdb on host None. Sep 08 19:14:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-cef7a309-eff4-49ae-8eb6-47238dcc3410 tempest-VolumesActionsTest-1885245278 None] Attach volume completed successfully. Sep 08 19:14:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-cef7a309-eff4-49ae-8eb6-47238dcc3410 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9" released by "attach_volume" :: held 0.103s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:14:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4f21b002-024e-4216-8023-33a384e23272 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-detach_volume" by "detach_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:14:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4f21b002-024e-4216-8023-33a384e23272 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:14:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4f21b002-024e-4216-8023-33a384e23272 tempest-VolumesActionsTest-1885245278 None] Detaching volume cd70fa16-2151-4e2c-a0e5-df2718223ac9 from instance ac46476e-97a2-4c46-9ba6-94fb1e69b8bd. Sep 08 19:14:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4f21b002-024e-4216-8023-33a384e23272 tempest-VolumesActionsTest-1885245278 None] Detach volume completed successfully. Sep 08 19:14:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4f21b002-024e-4216-8023-33a384e23272 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Flow 'volume_create_manager' (8753c42a-fb93-45f2-bab5-e977235b0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1079f4-ef38-4126-8afe-5398ace71cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1079f4-ef38-4126-8afe-5398ace71cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1316033567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b02ec7-c524-425c-8790-ecd929ca1fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53668f01eeaa4a9b8e22637656170635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:14:19Z,use_quota=True,user_id='6bae608b53f644339a57f5550f9880fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a967d6a-70cb-4ca5-b658-9ef8e044a91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a967d6a-70cb-4ca5-b658-9ef8e044a91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b0fe47-d8ef-4570-bbf9-c36195c6cc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b0fe47-d8ef-4570-bbf9-c36195c6cc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b02ec7-c524-425c-8790-ecd929ca1fc2', 'volume_name': 'volume-56b02ec7-c524-425c-8790-ecd929ca1fc2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518175e0-b015-4c10-9e6a-dbbb3a808dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518175e0-b015-4c10-9e6a-dbbb3a808dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322c3c69-06f0-4ccd-a900-4f7bfd61543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:18 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Volume 56b02ec7-c524-425c-8790-ecd929ca1fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b02ec7-c524-425c-8790-ecd929ca1fc2', 'volume_size': 1} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1316033567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b02ec7-c524-425c-8790-ecd929ca1fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53668f01eeaa4a9b8e22637656170635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:14:19Z,use_quota=True,user_id='6bae608b53f644339a57f5550f9880fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Creating volume 56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:14:18 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:14:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:18 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 1073741824 Sep 08 19:14:19 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:19 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 1073741824" returned: 0 in 0.478s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:19 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 Sep 08 19:14:19 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:19 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2" returned: 0 in 0.260s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322c3c69-06f0-4ccd-a900-4f7bfd61543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b02ec7-c524-425c-8790-ecd929ca1fc2', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046e68a8-b49c-41ce-8a6c-d4041a475902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:14:19 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Volume volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 (56b02ec7-c524-425c-8790-ecd929ca1fc2): created successfully Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (046e68a8-b49c-41ce-8a6c-d4041a475902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:14:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Flow 'volume_create_manager' (8753c42a-fb93-45f2-bab5-e977235b0126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:14:19 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d04f2f69-35c2-4b17-91fb-24013d881273 tempest-TestStampPattern-1491728165 None] Created volume successfully. Sep 08 19:14:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-67ff1547-ed28-4834-9e84-992819e06ad8 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9" by "attach_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:14:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-67ff1547-ed28-4834-9e84-992819e06ad8 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9" acquired by "attach_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:14:29 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:INSERT=33,cinder:UPDATE=150,cinder:SELECT=127,cinder:DELETE=12 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:29 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=94,cinder:INSERT=38,cinder:UPDATE=147,cinder:DELETE=13 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-67ff1547-ed28-4834-9e84-992819e06ad8 tempest-VolumesActionsTest-1885245278 None] Attaching volume cd70fa16-2151-4e2c-a0e5-df2718223ac9 to instance e57d40dd-c259-4d5e-91c7-5c6af7578d36 at mountpoint /dev/vdb on host None. Sep 08 19:14:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-67ff1547-ed28-4834-9e84-992819e06ad8 tempest-VolumesActionsTest-1885245278 None] Attach volume completed successfully. Sep 08 19:14:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-67ff1547-ed28-4834-9e84-992819e06ad8 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9" released by "attach_volume" :: held 0.126s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:14:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-62d0a12d-1508-4066-b67a-0f6418594374 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-detach_volume" by "detach_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:14:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-62d0a12d-1508-4066-b67a-0f6418594374 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:14:30 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-62d0a12d-1508-4066-b67a-0f6418594374 tempest-VolumesActionsTest-1885245278 None] Detaching volume cd70fa16-2151-4e2c-a0e5-df2718223ac9 from instance e57d40dd-c259-4d5e-91c7-5c6af7578d36. Sep 08 19:14:30 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-62d0a12d-1508-4066-b67a-0f6418594374 tempest-VolumesActionsTest-1885245278 None] Detach volume completed successfully. Sep 08 19:14:30 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-62d0a12d-1508-4066-b67a-0f6418594374 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:34 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:14:34 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:34 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.246s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:14:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[45132ad4-9b8f-4697-9349-3f12671290dd]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:35 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:14:35 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:35 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.364s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8993e6-0f6d-42f2-b233-be3d06299201]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:35 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:14:35 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:35 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.377s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.c0bc6729-86aa-4c59-8262-eaa611e479f4qyopa2ka.img {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:35 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.c0bc6729-86aa-4c59-8262-eaa611e479f4qyopa2ka.img Sep 08 19:14:35 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:40 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:40 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.c0bc6729-86aa-4c59-8262-eaa611e479f4qyopa2ka.img" returned: 0 in 4.699s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:40 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f1c877-bd9d-478c-83e6-df0f23d11da0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:14:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:40 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:14:40 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:41 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.523s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:41 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9, size 1024.00 MB, duration 4.70 sec, destination /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.c0bc6729-86aa-4c59-8262-eaa611e479f4qyopa2ka.img {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:14:41 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Converted 1024.00 MB image at 217.87 MB/s Sep 08 19:14:41 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] c0bc6729-86aa-4c59-8262-eaa611e479f4 was raw, no need to convert to raw {{(pid=87538) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 19:14:51 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:51 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-2680b394-8c7f-4469-a253-c024a80d97a6 req-61b24941-4e7e-485e-9780-ae6454536e86 tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.315s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Uploaded volume to glance image-id: c0bc6729-86aa-4c59-8262-eaa611e479f4. {{(pid=87538) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 19:15:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-2680b394-8c7f-4469-a253-c024a80d97a6 req-61b24941-4e7e-485e-9780-ae6454536e86 tempest-TestStampPattern-1491728165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.300s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-2680b394-8c7f-4469-a253-c024a80d97a6 req-61b24941-4e7e-485e-9780-ae6454536e86 tempest-TestStampPattern-1491728165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9978ecab-7c07-49a9-b49c-cbece6bf3453 tempest-VolumesActionsTest-1885245278 None] Copy volume to image completed successfully. Sep 08 19:15:00 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-2680b394-8c7f-4469-a253-c024a80d97a6 req-61b24941-4e7e-485e-9780-ae6454536e86 tempest-TestStampPattern-1491728165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-56b02ec7-c524-425c-8790-ecd929ca1fc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44513971-b03a-4d0b-94d6-9fc796fec33c', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:15:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-2680b394-8c7f-4469-a253-c024a80d97a6 req-61b24941-4e7e-485e-9780-ae6454536e86 tempest-TestStampPattern-1491728165 None] attachment_update completed successfully. Sep 08 19:15:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:01 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e616812-f3a4-40a2-86e3-acf6a51bbb75]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:02 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:15:02 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:02 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.378s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a7be5-30d3-4f41-a3b2-fd0057c69172]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:02 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:15:02 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:02 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.358s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:02 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img Sep 08 19:15:02 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-f83c428b-abd8-4c0e-9e80-4e4a3bfbaeb8 req-6776b25b-64d3-4002-bbc4-07b1ff1d50d6 tempest-TestStampPattern-1491728165 None] Terminate volume connection completed successfully. Sep 08 19:15:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-f83c428b-abd8-4c0e-9e80-4e4a3bfbaeb8 req-6776b25b-64d3-4002-bbc4-07b1ff1d50d6 tempest-TestStampPattern-1491728165 None] Deleting attachment 44513971-b03a-4d0b-94d6-9fc796fec33c. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:15:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:07 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img" returned: 0 in 4.526s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7f80e0-f068-4b53-9c94-341b6d94cb90]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:07 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:15:07 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:07 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.510s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:15:07 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Converted 1024.00 MB image at 226.18 MB/s Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] d05fe95d-15e3-4017-8737-13fee92c50ec was raw, converting to qcow2 {{(pid=87538) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[30671a01-d915-4209-b896-c0fa63668a59]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:07 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img Sep 08 19:15:07 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:08 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img" returned: 0 in 0.324s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:08 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img Sep 08 19:15:08 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:08 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img" returned: 1 in 0.319s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img /opt/stack/data/cinder/conversion/vol_upload_kw3j0npx {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:08 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img /opt/stack/data/cinder/conversion/vol_upload_kw3j0npx Sep 08 19:15:08 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:08 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img /opt/stack/data/cinder/conversion/vol_upload_kw3j0npx" returned: 0 in 0.245s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Image conversion details: src /opt/stack/data/cinder/conversion/cd70fa16-2151-4e2c-a0e5-df2718223ac9.temp_image.d05fe95d-15e3-4017-8737-13fee92c50ec99s755a8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kw3j0npx {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:15:08 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b07686f-7ccb-48e2-b6e4-2aecb1c5c59d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kw3j0npx {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:08 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kw3j0npx Sep 08 19:15:08 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:08 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kw3j0npx" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.215s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Uploaded volume to glance image-id: d05fe95d-15e3-4017-8737-13fee92c50ec. {{(pid=87538) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.246s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Creating offline snapshot af6f8bda-97a9-4b67-98d1-82bdd5375f29 of volume 56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:15:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7ac84b6d-85d2-44a4-98c8-4bdd4a7cf90b tempest-VolumesActionsTest-1885245278 None] Copy volume to image completed successfully. Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d74022-335d-47b7-a12c-876c9c6f1ac4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:10 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 Sep 08 19:15:10 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:10 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2" returned: 0 in 0.355s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:10 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 1G Sep 08 19:15:10 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:10 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 1G" returned: 0 in 0.453s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:11 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 Sep 08 19:15:11 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "cinder-quobyte-cd70fa16-2151-4e2c-a0e5-df2718223ac9" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-quobyte-cd70fa16-2151-4e2c-a0e5-df2718223ac9" acquired by "delete_volume" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0fee7d-0db8-464d-b58d-fb8e61eb09f2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:11 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:15:11 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:11 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29" returned: 0 in 0.303s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:11 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 is being set with open permissions: ugo+rw Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:11 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 Sep 08 19:15:11 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:11 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.374s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:11 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9 Sep 08 19:15:11 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:11 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29" returned: 0 in 0.243s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:11 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.info Sep 08 19:15:11 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:11 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-cd70fa16-2151-4e2c-a0e5-df2718223ac9" returned: 0 in 0.251s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-quobyte-cd70fa16-2151-4e2c-a0e5-df2718223ac9" released by "delete_volume" :: held 0.668s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:11 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Created reservations ['b9b47340-3821-4336-8959-2339434efbf0', '0a94a277-0036-4f4d-8d1d-38b948afcd09', '18eaf199-db1d-48ef-a7a1-34cf1cc4e747', '3c37674e-c5b3-441e-b063-b4bb0ea6e2fa'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.info" returned: 0 in 0.265s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:11 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.info is being set with open permissions: ugo+rw Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:11 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.info Sep 08 19:15:11 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:11 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:15:11 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:12 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.info" returned: 0 in 0.252s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d3a03aeb-5965-47e3-92cb-9b2bcb311b74 tempest-TestStampPattern-1491728165 None] Create snapshot completed successfully Sep 08 19:15:12 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.262s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:12 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:15:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Deleted volume successfully. Sep 08 19:15:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2e4ed044-aa2c-4220-8740-0c6bfd51a498 tempest-VolumesActionsTest-1885245278 None] Lock "cinder-cd70fa16-2151-4e2c-a0e5-df2718223ac9-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Flow 'volume_create_manager' (2f22a1b6-ec7e-48ac-8456-51422968852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4d83d1-99bf-4dc6-bd8b-51a664201c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4d83d1-99bf-4dc6-bd8b-51a664201c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1483137195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c3bbd5-992b-42c1-9b43-819a3fad43a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c2f9295e8b4aa08e88fa278796600c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:19Z,use_quota=True,user_id='93bbf318b2a64b34b24885eb56ccac5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896b4bff-eef9-4f81-8981-f0ba19e123fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896b4bff-eef9-4f81-8981-f0ba19e123fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d741de27-4571-47c5-9c60-0eeabb1e492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d741de27-4571-47c5-9c60-0eeabb1e492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c3bbd5-992b-42c1-9b43-819a3fad43a0', 'volume_name': 'volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee63f3-a229-4733-a79c-8ac9f1b88057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee63f3-a229-4733-a79c-8ac9f1b88057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ad5516-11cd-4b61-b063-059a6018bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:19 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Volume 13c3bbd5-992b-42c1-9b43-819a3fad43a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0', 'volume_size': 1} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1483137195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c3bbd5-992b-42c1-9b43-819a3fad43a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c2f9295e8b4aa08e88fa278796600c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:19Z,use_quota=True,user_id='93bbf318b2a64b34b24885eb56ccac5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Creating volume 13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:15:19 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:19 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 1073741824 Sep 08 19:15:19 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:19 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 1073741824" returned: 0 in 0.434s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:19 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 Sep 08 19:15:19 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:19 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Flow 'volume_create_manager' (9d5cb77d-244d-4a32-8692-42c8737ba4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e9dc8d-de52-483c-a0dc-4cb539ed903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e9dc8d-de52-483c-a0dc-4cb539ed903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1757112224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53668f01eeaa4a9b8e22637656170635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af6f8bda-97a9-4b67-98d1-82bdd5375f29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:20Z,use_quota=True,user_id='6bae608b53f644339a57f5550f9880fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4ceae0-8e33-42f3-87a6-b1340a254107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4ceae0-8e33-42f3-87a6-b1340a254107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1324b2-29c2-4fa2-85da-b722831b25bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1324b2-29c2-4fa2-85da-b722831b25bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba', 'volume_name': 'volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba', 'volume_size': 1, 'snapshot_id': 'af6f8bda-97a9-4b67-98d1-82bdd5375f29'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b275e7-55b5-4f75-bbae-1edcca59bc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b275e7-55b5-4f75-bbae-1edcca59bc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5392cc4-6df6-49d5-96a4-3c7303d27c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:20 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Volume e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba', 'volume_size': 1, 'snapshot_id': 'af6f8bda-97a9-4b67-98d1-82bdd5375f29'} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:20 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.086s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-quobyte-af6f8bda-97a9-4b67-98d1-82bdd5375f29-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ad5516-11cd-4b61-b063-059a6018bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a23b30-324b-40be-b512-95f0acca3ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-af6f8bda-97a9-4b67-98d1-82bdd5375f29-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Creating volume e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba from snapshot af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-quobyte-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:20 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Volume volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 (13c3bbd5-992b-42c1-9b43-819a3fad43a0): created successfully Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a23b30-324b-40be-b512-95f0acca3ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Flow 'volume_create_manager' (2f22a1b6-ec7e-48ac-8456-51422968852c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-15f3ce8d-b6ae-4b7a-af31-709b7b5debf9 tempest-VolumesCloneTest-1285179548 None] Created volume successfully. Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] snapshot: af6f8bda-97a9-4b67-98d1-82bdd5375f29, volume: e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc51ab52-3cd7-4888-839e-040bb14434b9]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:20 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 Sep 08 19:15:20 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:20 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29" returned: 0 in 0.396s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b02ec7-c524-425c-8790-ecd929ca1fc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c550a27-1202-4e08-a131-450e5edb2cea]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:20 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 Sep 08 19:15:20 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:20 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Flow 'volume_create_manager' (da5d2f20-df9e-4510-8292-3577145b5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43f0fe2-b520-4843-ba73-036511b194d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43f0fe2-b520-4843-ba73-036511b194d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-89202158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c2f9295e8b4aa08e88fa278796600c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=13c3bbd5-992b-42c1-9b43-819a3fad43a0,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:21Z,use_quota=True,user_id='93bbf318b2a64b34b24885eb56ccac5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92335ed-89c6-4c80-895c-00a3480b0bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92335ed-89c6-4c80-895c-00a3480b0bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4623182a-3b6a-457f-b6ca-548ee172f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4623182a-3b6a-457f-b6ca-548ee172f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5', 'volume_name': 'volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5', 'volume_size': 2, 'source_volid': '13c3bbd5-992b-42c1-9b43-819a3fad43a0', 'source_volstatus': 'available'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b109da07-0e65-48ca-a6c3-1c8faf764b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b109da07-0e65-48ca-a6c3-1c8faf764b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8410603e-d618-4b5b-a52b-66daa00007f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:21 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Volume 492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5', 'volume_size': 2, 'source_volid': '13c3bbd5-992b-42c1-9b43-819a3fad43a0', 'source_volstatus': 'available'} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:21 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2" returned: 0 in 0.467s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:15:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:21 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba Sep 08 19:15:21 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:26 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" returned: 0 in 5.389s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:15:26 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Converted 1024.00 MB image at 189.96 MB/s Sep 08 19:15:26 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba is being set with open permissions: ugo+rw Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:26 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba Sep 08 19:15:26 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:26 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" returned: 0 in 0.301s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" released by "_copy_volume_from_snapshot" :: held 6.659s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-af6f8bda-97a9-4b67-98d1-82bdd5375f29-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" released by "_create_volume_from_snapshot" :: held 6.751s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.781s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.833s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:26 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Cloning volume 13c3bbd5-992b-42c1-9b43-819a3fad43a0 to volume 492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5392cc4-6df6-49d5-96a4-3c7303d27c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba', 'volume_size': 1, 'snapshot_id': 'af6f8bda-97a9-4b67-98d1-82bdd5375f29'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf04215-cb7b-42e9-87a2-17aecb5d69ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Creating offline snapshot 4f7ed49c-1e72-4946-a9a0-4fec17c47007 of volume 13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:15:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Volume volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba (e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba): created successfully Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf04215-cb7b-42e9-87a2-17aecb5d69ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Flow 'volume_create_manager' (9d5cb77d-244d-4a32-8692-42c8737ba4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb41e5-bece-4da3-a80a-cfc02f6e5a4a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:27 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-88f4471c-d341-4696-a428-eaf308b92a5f tempest-TestStampPattern-1491728165 None] Created volume successfully. Sep 08 19:15:27 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 Sep 08 19:15:27 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:27 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:27 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 1G Sep 08 19:15:27 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:27 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 1G" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:27 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 Sep 08 19:15:27 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:28 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007" returned: 0 in 0.326s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:28 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 is being set with open permissions: ugo+rw Sep 08 19:15:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:28 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 Sep 08 19:15:28 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:28 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:28 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.info Sep 08 19:15:28 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:28 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.info" returned: 0 in 0.257s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:28 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.info is being set with open permissions: ugo+rw Sep 08 19:15:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:28 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.info Sep 08 19:15:28 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:29 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.info" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "cinder-quobyte-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] snapshot: 4f7ed49c-1e72-4946-a9a0-4fec17c47007, volume: 492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee625752-af2c-41fa-a8bd-62a1ef3e57e8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:29 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 Sep 08 19:15:29 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:29 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007" returned: 0 in 0.664s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e530744-a050-40f6-a604-e4a780fc1283]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:29 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 Sep 08 19:15:29 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:30 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0" returned: 0 in 0.422s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:15:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:15:30 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:15:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:30 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 Sep 08 19:15:30 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:15:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:34 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:15:34 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:35 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.853s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:35 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:15:35 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:15:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:15:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:15:36 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" returned: 0 in 6.640s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:36 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:15:36 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Converted 1024.00 MB image at 154.20 MB/s Sep 08 19:15:36 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 is being set with open permissions: ugo+rw Sep 08 19:15:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:36 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 Sep 08 19:15:36 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:37 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" returned: 0 in 0.307s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" released by "_copy_volume_from_snapshot" :: held 8.130s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "cinder-quobyte-4f7ed49c-1e72-4946-a9a0-4fec17c47007" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-4f7ed49c-1e72-4946-a9a0-4fec17c47007" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Deleting offline snapshot 4f7ed49c-1e72-4946-a9a0-4fec17c47007 of volume 13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] snapshot_file for this snap is: volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d166f18-28a0-4675-a572-c300236cfbe6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:37 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 Sep 08 19:15:37 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:37 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007" returned: 0 in 0.393s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c11826-3da7-4ca7-8529-6f53b1334653]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:37 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 Sep 08 19:15:37 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:38 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0" returned: 0 in 0.570s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:38 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 Sep 08 19:15:38 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:38 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=30,cinder:UPDATE=16,cinder:DELETE=3,cinder:INSERT=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:15:38 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007" returned: 0 in 0.396s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:38 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007 Sep 08 19:15:38 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:38 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0.4f7ed49c-1e72-4946-a9a0-4fec17c47007" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-4f7ed49c-1e72-4946-a9a0-4fec17c47007" released by "_delete_snapshot" :: held 1.746s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.053s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8410603e-d618-4b5b-a52b-66daa00007f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5', 'volume_size': 2, 'source_volid': '13c3bbd5-992b-42c1-9b43-819a3fad43a0', 'source_volstatus': 'available'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35a248f-2add-4d9b-8521-9f92067f19de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:39 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Volume volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 (492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5): created successfully Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35a248f-2add-4d9b-8521-9f92067f19de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Flow 'volume_create_manager' (da5d2f20-df9e-4510-8292-3577145b5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d646d696-92df-4614-aeac-cd89d913fc46 tempest-VolumesCloneTest-1285179548 None] Created volume successfully. Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "cinder-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "cinder-quobyte-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5cc4a-f295-4643-91fe-845495a949cb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:39 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 Sep 08 19:15:39 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:39 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" returned: 0 in 0.357s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:39 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5 Sep 08 19:15:39 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:40 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" returned: 0 in 0.255s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5" released by "delete_volume" :: held 0.653s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Created reservations ['fd7f0a5c-0d20-4fd6-93ae-0596fbb3167a', '491c732c-b536-44f6-bf66-9a9eb4e3aac5', '7eb61709-680e-49b1-ae32-20d16de802c6', 'e7256d12-83b1-4115-9008-8a2f74f62569'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:40 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:15:40 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:40 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:15:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Deleted volume successfully. Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d7bab122-e5f9-454d-9b38-92cfc58aaee2 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-492a7cbc-fc3e-41a1-8aa5-6d04ed761ad5-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "cinder-13c3bbd5-992b-42c1-9b43-819a3fad43a0-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-13c3bbd5-992b-42c1-9b43-819a3fad43a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "cinder-quobyte-13c3bbd5-992b-42c1-9b43-819a3fad43a0" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-13c3bbd5-992b-42c1-9b43-819a3fad43a0" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3663bfd-2ee3-4918-97fe-527413bc7e8b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:40 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 Sep 08 19:15:40 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:41 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0" returned: 0 in 0.370s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:41 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0 Sep 08 19:15:41 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:41 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-13c3bbd5-992b-42c1-9b43-819a3fad43a0" returned: 0 in 0.250s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-quobyte-13c3bbd5-992b-42c1-9b43-819a3fad43a0" released by "delete_volume" :: held 0.673s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Created reservations ['3605a576-1dce-4912-a20d-af1d3ec5b004', '4e506565-031e-4ee8-9126-a3f61990735d', 'd081b8ce-b767-435d-a76a-1c0e92df2a3c', 'd15e671f-9422-415f-963f-4016959fb776'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:41 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:15:41 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:41 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.261s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:15:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Deleted volume successfully. Sep 08 19:15:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f560a18f-2138-480c-bfc5-bbed58c88843 tempest-VolumesCloneTest-1285179548 None] Lock "cinder-13c3bbd5-992b-42c1-9b43-819a3fad43a0-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:51 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:15:51 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=40,cinder:UPDATE=46,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:15:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-642f563d-15d2-42b4-93e9-6908d05bf340 req-304736d6-a4e1-4a6d-9765-7ff30d4ce22a tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-642f563d-15d2-42b4-93e9-6908d05bf340 req-304736d6-a4e1-4a6d-9765-7ff30d4ce22a tempest-TestStampPattern-1491728165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-642f563d-15d2-42b4-93e9-6908d05bf340 req-304736d6-a4e1-4a6d-9765-7ff30d4ce22a tempest-TestStampPattern-1491728165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-642f563d-15d2-42b4-93e9-6908d05bf340 req-304736d6-a4e1-4a6d-9765-7ff30d4ce22a tempest-TestStampPattern-1491728165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f10c2492-d479-4142-925d-ff711060464b', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:15:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-642f563d-15d2-42b4-93e9-6908d05bf340 req-304736d6-a4e1-4a6d-9765-7ff30d4ce22a tempest-TestStampPattern-1491728165 None] attachment_update completed successfully. Sep 08 19:16:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-b8c4d669-753a-49ff-ae9b-226813616f9f req-d34d4f41-2b00-472f-9826-7d99d7c8ee98 tempest-TestStampPattern-1491728165 None] Terminate volume connection completed successfully. Sep 08 19:16:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-b8c4d669-753a-49ff-ae9b-226813616f9f req-d34d4f41-2b00-472f-9826-7d99d7c8ee98 tempest-TestStampPattern-1491728165 None] Deleting attachment f10c2492-d479-4142-925d-ff711060464b. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Lock "cinder-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-quobyte-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76b26a5-f75a-46c1-b4da-f34ed5d9ad2b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:07 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba Sep 08 19:16:07 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:07 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" returned: 0 in 0.358s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:07 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba Sep 08 19:16:07 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:07 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" returned: 0 in 0.246s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba" released by "delete_volume" :: held 0.643s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Created reservations ['3c675516-3629-4061-a7d7-c43e75effdc9', 'f9027340-f107-4aa7-bdd6-80ac11082a58', '2463fb18-ecd5-4499-8bb9-3e1059e435f4', '9be8bcf9-f244-4332-bfc8-53c6670220ea'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:07 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:07 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:08 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.288s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:08 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Deleted volume successfully. Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-64d0f801-1203-48fc-b5ce-ad01930c6b7b tempest-TestStampPattern-1491728165 None] Lock "cinder-e4f81dcb-ffd0-4917-80f6-ab391bf1b6ba-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-af6f8bda-97a9-4b67-98d1-82bdd5375f29-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Lock "cinder-af6f8bda-97a9-4b67-98d1-82bdd5375f29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-quobyte-56b02ec7-c524-425c-8790-ecd929ca1fc2" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-56b02ec7-c524-425c-8790-ecd929ca1fc2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-quobyte-af6f8bda-97a9-4b67-98d1-82bdd5375f29" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-af6f8bda-97a9-4b67-98d1-82bdd5375f29" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Deleting offline snapshot af6f8bda-97a9-4b67-98d1-82bdd5375f29 of volume 56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] snapshot_file for this snap is: volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3fafc5-7aa5-4779-bfea-656deb23678e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:08 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 Sep 08 19:16:08 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:08 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29" returned: 0 in 0.382s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b02ec7-c524-425c-8790-ecd929ca1fc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:16:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3838a27e-1eb6-4e83-aeae-5a74afc07766]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:09 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 Sep 08 19:16:09 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:09 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2" returned: 0 in 0.615s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:09 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 Sep 08 19:16:09 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:10 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:10 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29 Sep 08 19:16:10 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:10 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2.af6f8bda-97a9-4b67-98d1-82bdd5375f29" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-af6f8bda-97a9-4b67-98d1-82bdd5375f29" released by "_delete_snapshot" :: held 1.768s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-56b02ec7-c524-425c-8790-ecd929ca1fc2" released by "delete_snapshot" :: held 1.794s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:10 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Created reservations ['5d34203b-4cae-4d2a-b5e8-01ea3e1b3ba9', 'faad640d-ef73-4696-97de-2fda8be76e0b', 'deafa901-6e73-470a-934c-4b875cc85001', 'b62596e0-3f00-449a-91e2-fa30ebbd40a5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Delete snapshot completed successfully. Sep 08 19:16:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-96ad13e1-cd51-449f-afab-ac7867441829 tempest-TestStampPattern-1491728165 None] Lock "cinder-af6f8bda-97a9-4b67-98d1-82bdd5375f29-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-56b02ec7-c524-425c-8790-ecd929ca1fc2-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Lock "cinder-56b02ec7-c524-425c-8790-ecd929ca1fc2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Acquiring lock "cinder-quobyte-56b02ec7-c524-425c-8790-ecd929ca1fc2" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-56b02ec7-c524-425c-8790-ecd929ca1fc2" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c39e68-589a-463b-9aa8-f21b5bc929b6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:14 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 Sep 08 19:16:14 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:14 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:14 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2 Sep 08 19:16:14 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:15 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-56b02ec7-c524-425c-8790-ecd929ca1fc2" returned: 0 in 0.315s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Lock "cinder-quobyte-56b02ec7-c524-425c-8790-ecd929ca1fc2" released by "delete_volume" :: held 0.795s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Created reservations ['2cba41d3-8e33-473b-9da3-c48657f7cba0', '27476cc4-fc18-414a-aa84-754fb3cd95e4', 'a2b9d6f5-fa58-48c7-853b-9127ed43a199', '6a1b980e-4205-4475-a04d-5f74e211bb28'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:15 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:15 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:15 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Deleted volume successfully. Sep 08 19:16:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7286d317-8918-4843-bdff-5e43613031ca tempest-TestStampPattern-1491728165 None] Lock "cinder-56b02ec7-c524-425c-8790-ecd929ca1fc2-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Flow 'volume_create_manager' (aea64b4b-4d7d-4fe4-bbff-65c20e962db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec599076-2b34-4c0a-b8da-e3ff52f82bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec599076-2b34-4c0a-b8da-e3ff52f82bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1136762422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cf8687-5616-44eb-be96-123b349f8688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76854a54efdc41da9e6fce0db004eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:22Z,use_quota=True,user_id='27a6116867804a72895afbcec70c3dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2350453-09e4-4349-b86a-a7fcfe450d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2350453-09e4-4349-b86a-a7fcfe450d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2622d34-5118-4a1e-b3dd-47325dcec056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2622d34-5118-4a1e-b3dd-47325dcec056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cf8687-5616-44eb-be96-123b349f8688', 'volume_name': 'volume-42cf8687-5616-44eb-be96-123b349f8688', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef71dd1e-d946-4d6a-8d1a-114fd970c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef71dd1e-d946-4d6a-8d1a-114fd970c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b76800-7d8d-43b3-921a-7e6abd258dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:22 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Volume 42cf8687-5616-44eb-be96-123b349f8688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cf8687-5616-44eb-be96-123b349f8688', 'volume_size': 1} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1136762422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cf8687-5616-44eb-be96-123b349f8688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76854a54efdc41da9e6fce0db004eb32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:22Z,use_quota=True,user_id='27a6116867804a72895afbcec70c3dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Creating volume 42cf8687-5616-44eb-be96-123b349f8688 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:22 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:22 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 1073741824 Sep 08 19:16:22 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:22 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 1073741824" returned: 0 in 0.448s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:22 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 Sep 08 19:16:22 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:22 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b76800-7d8d-43b3-921a-7e6abd258dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cf8687-5616-44eb-be96-123b349f8688', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870bb446-2cdc-4358-baab-ba031bdd9142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:23 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Volume volume-42cf8687-5616-44eb-be96-123b349f8688 (42cf8687-5616-44eb-be96-123b349f8688): created successfully Sep 08 19:16:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870bb446-2cdc-4358-baab-ba031bdd9142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:23 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Flow 'volume_create_manager' (aea64b4b-4d7d-4fe4-bbff-65c20e962db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2fa70ff2-ae66-4b70-b8c9-8b9963b36614 tempest-TestMinimumBasicScenario-620124998 None] Created volume successfully. Sep 08 19:16:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-6ec629bf-d623-4723-aaf0-ac8fcbe83de1 req-d2fb9832-bdc5-4b56-a1d4-78b9721cd968 tempest-TestMinimumBasicScenario-620124998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-6ec629bf-d623-4723-aaf0-ac8fcbe83de1 req-d2fb9832-bdc5-4b56-a1d4-78b9721cd968 tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-6ec629bf-d623-4723-aaf0-ac8fcbe83de1 req-d2fb9832-bdc5-4b56-a1d4-78b9721cd968 tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-6ec629bf-d623-4723-aaf0-ac8fcbe83de1 req-d2fb9832-bdc5-4b56-a1d4-78b9721cd968 tempest-TestMinimumBasicScenario-620124998 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-42cf8687-5616-44eb-be96-123b349f8688', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbce148d-8689-4177-b73a-3ea3b2ee0b6b', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:16:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-6ec629bf-d623-4723-aaf0-ac8fcbe83de1 req-d2fb9832-bdc5-4b56-a1d4-78b9721cd968 tempest-TestMinimumBasicScenario-620124998 None] attachment_update completed successfully. Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Flow 'volume_create_manager' (95bea4d5-7ba5-4549-a9a0-290e6da37137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6d8eb3-1b41-4d4a-9506-6359458cfe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6d8eb3-1b41-4d4a-9506-6359458cfe8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ab927b-87cd-46f6-ad4a-ea63c1422e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144bc87853584415a3fb315e77600cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:34Z,use_quota=True,user_id='13fe8160426e40fcb2348eaf0d41c457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37391f04-1bbf-4183-a393-1285d36b076c),volume_type_id=37391f04-1bbf-4183-a393-1285d36b076c)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a1fcb2-8597-4a9d-bcd6-4bd0bf089c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a1fcb2-8597-4a9d-bcd6-4bd0bf089c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42920a31-fb46-4e12-a826-a95506f1747a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:33 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42920a31-fb46-4e12-a826-a95506f1747a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70ab927b-87cd-46f6-ad4a-ea63c1422e2c', 'volume_name': 'volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c', 'volume_size': 1, 'image_id': '47096601-6c9e-49ee-bf54-0f59c59197dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47096601-6c9e-49ee-bf54-0f59c59197dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbea9e7284151b6fd7e25edba2182607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '144bc87853584415a3fb315e77600cd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '40c2e9f50987bd10a5262ad6264ded43aaf2aff3ab1497dff3c178359600c0544f5d8fd4f2c1a8112a905c980c17dcc82d84ddc06939c2403d7a802ccd2f0192', 'id': '47096601-6c9e-49ee-bf54-0f59c59197dd', 'created_at': datetime.datetime(2026, 9, 8, 17, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 16, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47096601-6c9e-49ee-bf54-0f59c59197dd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be37ab93-b87b-4fb9-8d63-1959899fc144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be37ab93-b87b-4fb9-8d63-1959899fc144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd75fcb-8628-42de-8157-c0ce74933a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Volume 70ab927b-87cd-46f6-ad4a-ea63c1422e2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c', 'volume_size': 1, 'image_id': '47096601-6c9e-49ee-bf54-0f59c59197dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47096601-6c9e-49ee-bf54-0f59c59197dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbea9e7284151b6fd7e25edba2182607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '144bc87853584415a3fb315e77600cd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '40c2e9f50987bd10a5262ad6264ded43aaf2aff3ab1497dff3c178359600c0544f5d8fd4f2c1a8112a905c980c17dcc82d84ddc06939c2403d7a802ccd2f0192', 'id': '47096601-6c9e-49ee-bf54-0f59c59197dd', 'created_at': datetime.datetime(2026, 9, 8, 17, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 16, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47096601-6c9e-49ee-bf54-0f59c59197dd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Trying to clone 70ab927b-87cd-46f6-ad4a-ea63c1422e2c from image 47096601-6c9e-49ee-bf54-0f59c59197dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/47096601-6c9e-49ee-bf54-0f59c59197dd', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:16:34 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa2912-1b9c-431e-bffc-fd21e86498bb]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:34 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD Sep 08 19:16:34 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:34 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:34 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:34 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:34 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.268s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:16:34 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD Sep 08 19:16:34 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:34 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Temporary image 47096601-6c9e-49ee-bf54-0f59c59197dd is fetched for user 13fe8160426e40fcb2348eaf0d41c457. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc4db4-e658-4a3f-9b7e-6e37531451b5]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:35 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD Sep 08 19:16:35 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:35 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:35 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD Sep 08 19:16:35 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:35 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ab927b-87cd-46f6-ad4a-ea63c1422e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='144bc87853584415a3fb315e77600cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:34Z,use_quota=True,user_id='13fe8160426e40fcb2348eaf0d41c457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37391f04-1bbf-4183-a393-1285d36b076c),volume_type_id=37391f04-1bbf-4183-a393-1285d36b076c)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Creating volume 70ab927b-87cd-46f6-ad4a-ea63c1422e2c {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:35 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:35 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c 1073741824 Sep 08 19:16:35 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:36 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c 1073741824" returned: 0 in 0.393s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:36 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c Sep 08 19:16:36 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:36 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c" returned: 0 in 0.259s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Attempting download of 47096601-6c9e-49ee-bf54-0f59c59197dd ((None, [{'url': 'file:///opt/stack/data/glance/images/47096601-6c9e-49ee-bf54-0f59c59197dd', 'metadata': {}}])) to volume 70ab927b-87cd-46f6-ad4a-ea63c1422e2c. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee602423-9cec-4380-b101-7224fa92d61f]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47096601-6c9e-49ee-bf54-0f59c59197dd_y6591os1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:36 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47096601-6c9e-49ee-bf54-0f59c59197dd_y6591os1 Sep 08 19:16:36 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:36 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47096601-6c9e-49ee-bf54-0f59c59197dd_y6591os1" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47096601-6c9e-49ee-bf54-0f59c59197dd_y6591os1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:36 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47096601-6c9e-49ee-bf54-0f59c59197dd_y6591os1 Sep 08 19:16:36 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:37 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47096601-6c9e-49ee-bf54-0f59c59197dd_y6591os1" returned: 1 in 0.328s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47096601-6c9e-49ee-bf54-0f59c59197dd_y6591os1' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae848b50-e7d6-45e9-bebb-e410ac39039b]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:37 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD Sep 08 19:16:37 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:37 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:37 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD Sep 08 19:16:37 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:37 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD" returned: 1 in 0.308s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] 47096601-6c9e-49ee-bf54-0f59c59197dd was raw, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:16:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:37 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c Sep 08 19:16:37 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:38 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c" returned: 0 in 0.423s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47096601-6c9e-49ee-bf54-0f59c59197dd_zs6g1dwzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:16:38 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:38 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c 1G Sep 08 19:16:38 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:38 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c 1G" returned: 0 in 0.295s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Downloaded image 47096601-6c9e-49ee-bf54-0f59c59197dd ((None, [{'url': 'file:///opt/stack/data/glance/images/47096601-6c9e-49ee-bf54-0f59c59197dd', 'metadata': {}}])) to volume 70ab927b-87cd-46f6-ad4a-ea63c1422e2c successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Temporary image 47096601-6c9e-49ee-bf54-0f59c59197dd for user 13fe8160426e40fcb2348eaf0d41c457 is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Marking volume 70ab927b-87cd-46f6-ad4a-ea63c1422e2c as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Copying metadata from image 47096601-6c9e-49ee-bf54-0f59c59197dd to 70ab927b-87cd-46f6-ad4a-ea63c1422e2c. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Creating volume glance metadata for volume 70ab927b-87cd-46f6-ad4a-ea63c1422e2c backed by image 47096601-6c9e-49ee-bf54-0f59c59197dd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '47096601-6c9e-49ee-bf54-0f59c59197dd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dbea9e7284151b6fd7e25edba2182607', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd75fcb-8628-42de-8157-c0ce74933a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c', 'volume_size': 1, 'image_id': '47096601-6c9e-49ee-bf54-0f59c59197dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47096601-6c9e-49ee-bf54-0f59c59197dd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbea9e7284151b6fd7e25edba2182607', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '144bc87853584415a3fb315e77600cd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '40c2e9f50987bd10a5262ad6264ded43aaf2aff3ab1497dff3c178359600c0544f5d8fd4f2c1a8112a905c980c17dcc82d84ddc06939c2403d7a802ccd2f0192', 'id': '47096601-6c9e-49ee-bf54-0f59c59197dd', 'created_at': datetime.datetime(2026, 9, 8, 17, 16, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 16, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47096601-6c9e-49ee-bf54-0f59c59197dd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab61511-81be-42d9-8fc4-a994ca4573a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:38 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Volume volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c (70ab927b-87cd-46f6-ad4a-ea63c1422e2c): created successfully Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab61511-81be-42d9-8fc4-a994ca4573a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Flow 'volume_create_manager' (95bea4d5-7ba5-4549-a9a0-290e6da37137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e5a0e8e0-34d0-4c3f-aa92-38485f0bcd76 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Created volume successfully. Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Acquiring lock "cinder-70ab927b-87cd-46f6-ad4a-ea63c1422e2c-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "cinder-70ab927b-87cd-46f6-ad4a-ea63c1422e2c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Acquiring lock "cinder-quobyte-70ab927b-87cd-46f6-ad4a-ea63c1422e2c" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "cinder-quobyte-70ab927b-87cd-46f6-ad4a-ea63c1422e2c" acquired by "delete_volume" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e318b4e-6952-41fc-a98d-9a6fee245d10]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:39 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c Sep 08 19:16:39 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:39 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c" returned: 0 in 0.378s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:39 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c Sep 08 19:16:39 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:39 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-70ab927b-87cd-46f6-ad4a-ea63c1422e2c" returned: 0 in 0.261s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "cinder-quobyte-70ab927b-87cd-46f6-ad4a-ea63c1422e2c" released by "delete_volume" :: held 0.677s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:39 devstack cinder-volume[87538]: WARNING cinder.quota [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:16:39 devstack cinder-volume[87538]: WARNING cinder.quota [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Created reservations ['1fa52650-a5ec-4029-a552-f8364ca6f1ef', 'bb798658-c968-47e2-abb0-7f4d8d85353c', 'c8ecfe9a-f490-481f-a109-6238400e47f0', '5095d053-7078-493f-b976-09253827cffe'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:39 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:39 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:40 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:40 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Deleted volume successfully. Sep 08 19:16:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-aeda5fed-c14e-4597-b811-209fdccd8a86 tempest-VolumeAndVolumeTypeFromImageTest-651791528 None] Lock "cinder-70ab927b-87cd-46f6-ad4a-ea63c1422e2c-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (76aa5088-78de-4f8a-89fe-770a8b487eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bbf5c6-0b62-42b9-b738-e646a91017fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bbf5c6-0b62-42b9-b738-e646a91017fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64570472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0d00bd-e816-4ed9-9a35-926f7653daab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:45Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f667df39-9fd5-45e0-a42a-95345017547c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f667df39-9fd5-45e0-a42a-95345017547c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b34dff0-53e1-4f24-8f64-81ce62c25b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b34dff0-53e1-4f24-8f64-81ce62c25b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0d00bd-e816-4ed9-9a35-926f7653daab', 'volume_name': 'volume-ea0d00bd-e816-4ed9-9a35-926f7653daab', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fb4f52-29e9-4b0b-aec9-eae3ae5004bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fb4f52-29e9-4b0b-aec9-eae3ae5004bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707d47f9-3bb4-46f6-bb17-eb686ef3ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:44 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume ea0d00bd-e816-4ed9-9a35-926f7653daab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0d00bd-e816-4ed9-9a35-926f7653daab', 'volume_size': 1} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64570472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0d00bd-e816-4ed9-9a35-926f7653daab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:45Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Creating volume ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:44 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:44 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab 1073741824 Sep 08 19:16:44 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:45 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab 1073741824" returned: 0 in 0.414s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:45 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab Sep 08 19:16:45 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:45 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab" returned: 0 in 0.239s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707d47f9-3bb4-46f6-bb17-eb686ef3ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0d00bd-e816-4ed9-9a35-926f7653daab', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbad88f-f1f8-4bf4-85e5-da5cc749a220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:45 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume volume-ea0d00bd-e816-4ed9-9a35-926f7653daab (ea0d00bd-e816-4ed9-9a35-926f7653daab): created successfully Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbad88f-f1f8-4bf4-85e5-da5cc749a220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (76aa5088-78de-4f8a-89fe-770a8b487eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2540dbca-f14f-403f-804c-cafd66d3676d tempest-CreateVolumesFromSnapshotTest-912737369 None] Created volume successfully. Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Creating offline snapshot 3a6a74af-716b-4dbe-98a5-750abd607ba7 of volume ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d050c303-0142-444e-abb4-825d5872a7ec]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:45 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab Sep 08 19:16:45 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:46 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab" returned: 0 in 0.357s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:46 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 1G Sep 08 19:16:46 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:46 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 1G" returned: 0 in 0.395s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea0d00bd-e816-4ed9-9a35-926f7653daab -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:46 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea0d00bd-e816-4ed9-9a35-926f7653daab -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 Sep 08 19:16:46 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:46 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea0d00bd-e816-4ed9-9a35-926f7653daab -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:46 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 is being set with open permissions: ugo+rw Sep 08 19:16:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:46 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 Sep 08 19:16:46 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:47 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7" returned: 0 in 0.247s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:47 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.info Sep 08 19:16:47 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:47 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.info" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:47 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.info is being set with open permissions: ugo+rw Sep 08 19:16:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:47 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.info Sep 08 19:16:47 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:47 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.info" returned: 0 in 0.338s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:47 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8b21dbde-17fe-4537-80a0-2a56547fb107 tempest-CreateVolumesFromSnapshotTest-912737369 None] Create snapshot completed successfully Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (e1567f8a-9abd-470c-92ef-52b96e6ed81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1fa114-1ba9-4eab-b4a5-f1ee5d41c42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1fa114-1ba9-4eab-b4a5-f1ee5d41c42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373224283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8bebfb-d4c3-4eeb-9756-365619bc63fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:49Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9e4607-bf71-4779-9ac9-5a5642ad4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec9e4607-bf71-4779-9ac9-5a5642ad4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a91ef0d-6e57-45f1-9cc6-65ec097ed825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a91ef0d-6e57-45f1-9cc6-65ec097ed825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8bebfb-d4c3-4eeb-9756-365619bc63fc', 'volume_name': 'volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb3a884-baf1-44e6-aded-4e5f4cb1a9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb3a884-baf1-44e6-aded-4e5f4cb1a9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c19b471-063e-4f4c-aaeb-c7e1175146f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume ea8bebfb-d4c3-4eeb-9756-365619bc63fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc', 'volume_size': 1} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1373224283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8bebfb-d4c3-4eeb-9756-365619bc63fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:49Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Creating volume ea8bebfb-d4c3-4eeb-9756-365619bc63fc {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:49 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:49 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc 1073741824 Sep 08 19:16:49 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (744fced0-28d7-42a3-ba27-c81da355ef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66381e62-8718-49cc-8b9e-e754f95c478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66381e62-8718-49cc-8b9e-e754f95c478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-878492401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4be453b-706d-4cd1-a6fb-5d43bce76f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:50Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e5227f-9370-4654-ac32-fd8cf68f2e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e5227f-9370-4654-ac32-fd8cf68f2e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4be2333-3da1-4e54-99b6-c09d9b81022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4be2333-3da1-4e54-99b6-c09d9b81022a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4be453b-706d-4cd1-a6fb-5d43bce76f4b', 'volume_name': 'volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a51827-11ba-4c50-9bdd-976093d9cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a51827-11ba-4c50-9bdd-976093d9cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e96fb-56e5-4b7f-ac7e-0a3951371194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume e4be453b-706d-4cd1-a6fb-5d43bce76f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b', 'volume_size': 1} Sep 08 19:16:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:50 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc 1073741824" returned: 0 in 0.592s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:50 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc Sep 08 19:16:50 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (8b93092f-cd4b-442d-a0ba-6b5cb0bc9baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d7759c-1127-4e99-a838-5d72177f6810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d7759c-1127-4e99-a838-5d72177f6810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347630980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33761e3-21e8-4248-858c-cd937b538e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:50Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e340b-fa73-4147-beaa-00bbe4ed3d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4e340b-fa73-4147-beaa-00bbe4ed3d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39951587-250f-445d-b15f-12eda358d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39951587-250f-445d-b15f-12eda358d406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33761e3-21e8-4248-858c-cd937b538e93', 'volume_name': 'volume-e33761e3-21e8-4248-858c-cd937b538e93', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72722f3-3774-45b5-8993-f49169a63d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72722f3-3774-45b5-8993-f49169a63d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d08c6-48aa-47c0-b94a-73812093a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume e33761e3-21e8-4248-858c-cd937b538e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33761e3-21e8-4248-858c-cd937b538e93', 'volume_size': 1} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:50 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc" returned: 0 in 0.366s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-878492401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4be453b-706d-4cd1-a6fb-5d43bce76f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:50Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Creating volume e4be453b-706d-4cd1-a6fb-5d43bce76f4b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:50 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c19b471-063e-4f4c-aaeb-c7e1175146f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b 1073741824 Sep 08 19:16:50 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00099af1-9431-480a-beb5-6c4b8d547ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc (ea8bebfb-d4c3-4eeb-9756-365619bc63fc): created successfully Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00099af1-9431-480a-beb5-6c4b8d547ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (e1567f8a-9abd-470c-92ef-52b96e6ed81b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:50 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-656f6a2b-e392-4cdd-b49a-912f0e73ca30 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created volume successfully. Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (b5daa3c1-baad-4f26-9a81-9142a7fdc454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877ffb47-ab38-496c-9eaa-279142f7f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877ffb47-ab38-496c-9eaa-279142f7f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114656858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e63eec-061e-4c71-bd7d-011162eac7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:51Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabc3697-f27c-4caf-b161-08e741af66bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabc3697-f27c-4caf-b161-08e741af66bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836af091-7c18-4cc1-9886-74beaac8db2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836af091-7c18-4cc1-9886-74beaac8db2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e63eec-061e-4c71-bd7d-011162eac7c6', 'volume_name': 'volume-36e63eec-061e-4c71-bd7d-011162eac7c6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883b3aa-64c1-4e7f-8dda-f5b7ade2c766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e883b3aa-64c1-4e7f-8dda-f5b7ade2c766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb2dd67-fb54-407d-a80b-35cde489c5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:50 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume 36e63eec-061e-4c71-bd7d-011162eac7c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e63eec-061e-4c71-bd7d-011162eac7c6', 'volume_size': 1} Sep 08 19:16:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:51 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b 1073741824" returned: 0 in 0.656s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (5bd928a2-b0d3-4d21-9b11-bc05913c7745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f1534b-6a7e-4d67-9c33-6ac1cc0ac083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f1534b-6a7e-4d67-9c33-6ac1cc0ac083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149902049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97d0b3a-0014-4043-8741-6044f3a44a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:51Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6d34ce-4637-43f9-b8b8-22218efcdf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6d34ce-4637-43f9-b8b8-22218efcdf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbcc527-d017-41fe-a141-2a85d1b73490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbcc527-d017-41fe-a141-2a85d1b73490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97d0b3a-0014-4043-8741-6044f3a44a31', 'volume_name': 'volume-c97d0b3a-0014-4043-8741-6044f3a44a31', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305c9d6e-cd55-4ed0-8774-df34493f4eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305c9d6e-cd55-4ed0-8774-df34493f4eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0db38c-8d24-40d0-a4e3-10eb00e67688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:51 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume c97d0b3a-0014-4043-8741-6044f3a44a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97d0b3a-0014-4043-8741-6044f3a44a31', 'volume_size': 1} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:51 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b Sep 08 19:16:51 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:51 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b" returned: 0 in 0.251s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347630980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33761e3-21e8-4248-858c-cd937b538e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:50Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Creating volume e33761e3-21e8-4248-858c-cd937b538e93 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:51 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=63,cinder:UPDATE=46,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e96fb-56e5-4b7f-ac7e-0a3951371194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:51 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 1073741824 Sep 08 19:16:51 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85704435-9a7d-4e08-aa22-3cc5e6da52e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:51 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b (e4be453b-706d-4cd1-a6fb-5d43bce76f4b): created successfully Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85704435-9a7d-4e08-aa22-3cc5e6da52e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (744fced0-28d7-42a3-ba27-c81da355ef3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-80ef2cc6-c123-42e7-9fde-7bccb6c2f091 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created volume successfully. Sep 08 19:16:51 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 1073741824" returned: 0 in 0.429s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:51 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=52,cinder:UPDATE=58,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:52 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 Sep 08 19:16:52 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:52 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114656858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e63eec-061e-4c71-bd7d-011162eac7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:51Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Creating volume 36e63eec-061e-4c71-bd7d-011162eac7c6 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:52 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d08c6-48aa-47c0-b94a-73812093a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33761e3-21e8-4248-858c-cd937b538e93', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f7622e-e39b-46d0-b655-80322e7e3081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:52 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 1073741824 Sep 08 19:16:52 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume volume-e33761e3-21e8-4248-858c-cd937b538e93 (e33761e3-21e8-4248-858c-cd937b538e93): created successfully Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f7622e-e39b-46d0-b655-80322e7e3081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (8b93092f-cd4b-442d-a0ba-6b5cb0bc9baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-965327be-f489-42b4-b564-7c2001f6a149 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created volume successfully. Sep 08 19:16:52 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 1073741824" returned: 0 in 0.444s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:52 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 Sep 08 19:16:52 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:53 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6" returned: 0 in 0.256s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149902049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97d0b3a-0014-4043-8741-6044f3a44a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492bd677927d40cea30234bc061ea877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:51Z,use_quota=True,user_id='a5f8158089ca4f5fbabeae8c4645951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Creating volume c97d0b3a-0014-4043-8741-6044f3a44a31 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:53 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb2dd67-fb54-407d-a80b-35cde489c5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e63eec-061e-4c71-bd7d-011162eac7c6', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:53 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 1073741824 Sep 08 19:16:53 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08979b0c-d446-434c-a819-9a066321d39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume volume-36e63eec-061e-4c71-bd7d-011162eac7c6 (36e63eec-061e-4c71-bd7d-011162eac7c6): created successfully Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08979b0c-d446-434c-a819-9a066321d39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (b5daa3c1-baad-4f26-9a81-9142a7fdc454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5f0425e2-b2c3-401f-a051-4b4dc1a72999 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created volume successfully. Sep 08 19:16:53 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 1073741824" returned: 0 in 0.460s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:53 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 Sep 08 19:16:53 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:53 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31" returned: 0 in 0.255s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0db38c-8d24-40d0-a4e3-10eb00e67688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97d0b3a-0014-4043-8741-6044f3a44a31', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2378dc2-800a-4907-94aa-7f7af381042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Volume volume-c97d0b3a-0014-4043-8741-6044f3a44a31 (c97d0b3a-0014-4043-8741-6044f3a44a31): created successfully Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2378dc2-800a-4907-94aa-7f7af381042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Flow 'volume_create_manager' (5bd928a2-b0d3-4d21-9b11-bc05913c7745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-46ac37d7-2cae-4cf6-871c-ded3a597eed4 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created volume successfully. Sep 08 19:16:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-c97d0b3a-0014-4043-8741-6044f3a44a31-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-c97d0b3a-0014-4043-8741-6044f3a44a31-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-c97d0b3a-0014-4043-8741-6044f3a44a31" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-c97d0b3a-0014-4043-8741-6044f3a44a31" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:54 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f19af9-65f7-472d-a8b7-aa7b07c1d1b6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:54 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 Sep 08 19:16:54 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:55 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:55 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31 Sep 08 19:16:55 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:55 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c97d0b3a-0014-4043-8741-6044f3a44a31" returned: 0 in 0.256s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-c97d0b3a-0014-4043-8741-6044f3a44a31" released by "delete_volume" :: held 0.691s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created reservations ['427d919f-a120-4967-b04d-90e802c02b87', 'd7f33b23-85af-4b6c-a7e1-beccc0be0a2e', '9d3f295d-9862-4061-86be-4ac599768d67', '8c330f8d-4b55-4e1f-89c7-c72e1018aad5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:55 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:55 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:55 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-36e63eec-061e-4c71-bd7d-011162eac7c6-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.296s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Deleted volume successfully. Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-36e63eec-061e-4c71-bd7d-011162eac7c6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-749b025c-7f3f-4d20-b018-137c99196143 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-c97d0b3a-0014-4043-8741-6044f3a44a31-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-36e63eec-061e-4c71-bd7d-011162eac7c6" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-36e63eec-061e-4c71-bd7d-011162eac7c6" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85384e2-9492-4a4e-9a33-3da8b4dba815]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:56 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 Sep 08 19:16:56 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:56 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6" returned: 0 in 0.390s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:56 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6 Sep 08 19:16:56 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:56 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-36e63eec-061e-4c71-bd7d-011162eac7c6" returned: 0 in 0.260s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-36e63eec-061e-4c71-bd7d-011162eac7c6" released by "delete_volume" :: held 0.703s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Created reservations ['a67ca5d9-3724-429d-8456-a71e919238f2', '9d6ad07b-279c-4f2c-b419-9306082b58cb', '0615366a-597d-4e72-b958-4f9af3975e7d', '31abdd68-44e2-4a68-9586-75460bcbdb80'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:56 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:56 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-e33761e3-21e8-4248-858c-cd937b538e93-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-e33761e3-21e8-4248-858c-cd937b538e93-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:57 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:57 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Deleted volume successfully. Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-e33761e3-21e8-4248-858c-cd937b538e93" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2ebbaa10-a2c6-4e02-a121-21238c6b80cc tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-36e63eec-061e-4c71-bd7d-011162eac7c6-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-e33761e3-21e8-4248-858c-cd937b538e93" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9b4808-2d99-4efd-9252-9fd02f4bcf08]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:57 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 Sep 08 19:16:57 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:57 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93" returned: 0 in 0.362s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:57 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93 Sep 08 19:16:57 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:57 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e33761e3-21e8-4248-858c-cd937b538e93" returned: 0 in 0.251s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-e33761e3-21e8-4248-858c-cd937b538e93" released by "delete_volume" :: held 0.660s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created reservations ['73a80a1b-b249-4c69-89c8-e1c4a7d2fe04', '7ec726df-dcf5-47d4-adb7-4a637913a4a1', 'e980ff5b-9a49-4373-824b-888eff468ceb', 'cd8cad0b-07c6-4002-9c5a-35b6b1ffb17b'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:58 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:58 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-e4be453b-706d-4cd1-a6fb-5d43bce76f4b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-e4be453b-706d-4cd1-a6fb-5d43bce76f4b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:58 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.291s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Deleted volume successfully. Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-e4be453b-706d-4cd1-a6fb-5d43bce76f4b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-e4be453b-706d-4cd1-a6fb-5d43bce76f4b" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d295b17c-2ba7-40af-bcbc-9de113e9c886 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-e33761e3-21e8-4248-858c-cd937b538e93-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b963b345-3d85-4a46-ac13-c16873a87628]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:58 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b Sep 08 19:16:58 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:58 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b" returned: 0 in 0.368s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:58 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b Sep 08 19:16:58 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:59 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e4be453b-706d-4cd1-a6fb-5d43bce76f4b" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-e4be453b-706d-4cd1-a6fb-5d43bce76f4b" released by "delete_volume" :: held 0.685s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Created reservations ['5b4f35b2-bf52-4108-9e8d-3aede01d206f', '3ba64402-1040-488d-8d5e-6da3ad0afea0', '9ba6a99f-65b6-48fe-b24c-4f6448185372', '5453bcfd-8700-4885-aa34-dfe3406c3c1a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:59 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:16:59 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:59 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-ea8bebfb-d4c3-4eeb-9756-365619bc63fc-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Deleted volume successfully. Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-ea8bebfb-d4c3-4eeb-9756-365619bc63fc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3923a791-5b55-49ef-b391-16a116a066bb tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-e4be453b-706d-4cd1-a6fb-5d43bce76f4b-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-ea8bebfb-d4c3-4eeb-9756-365619bc63fc" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-ea8bebfb-d4c3-4eeb-9756-365619bc63fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f15a651-2a6e-4fc9-8d49-bd27296b0ecb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:59 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc Sep 08 19:16:59 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:59 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc" returned: 0 in 0.389s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:00 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc Sep 08 19:17:00 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:00 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea8bebfb-d4c3-4eeb-9756-365619bc63fc" returned: 0 in 0.282s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-ea8bebfb-d4c3-4eeb-9756-365619bc63fc" released by "delete_volume" :: held 0.715s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created reservations ['884c3d3a-9822-4a0e-9aa0-f2025b735ef7', '10afa8eb-4fa0-4355-9bac-1426a745dc7c', 'a4d507cf-1940-459d-83b5-ac96873e46ad', '30fae467-88d2-4e17-9379-d18c86420426'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:00 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:17:00 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-3a6a74af-716b-4dbe-98a5-750abd607ba7-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-3a6a74af-716b-4dbe-98a5-750abd607ba7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-ea0d00bd-e816-4ed9-9a35-926f7653daab" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-ea0d00bd-e816-4ed9-9a35-926f7653daab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-3a6a74af-716b-4dbe-98a5-750abd607ba7" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:00 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.323s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Deleted volume successfully. Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-3a6a74af-716b-4dbe-98a5-750abd607ba7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Deleting offline snapshot 3a6a74af-716b-4dbe-98a5-750abd607ba7 of volume ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] snapshot_file for this snap is: volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-075da7c8-7cea-4f69-9ea1-d3313de86d53 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-ea8bebfb-d4c3-4eeb-9756-365619bc63fc-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[262d2855-6b7f-49ab-89a8-bf575d1c0a57]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:00 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 Sep 08 19:17:00 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:01 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7" returned: 0 in 0.357s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea0d00bd-e816-4ed9-9a35-926f7653daab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91bafc3-52a3-45b4-811e-b99fde117fdb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:01 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab Sep 08 19:17:01 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:01 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab" returned: 0 in 0.361s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:01 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 Sep 08 19:17:01 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:01 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7" returned: 0 in 0.319s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:01 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7 Sep 08 19:17:01 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:02 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab.3a6a74af-716b-4dbe-98a5-750abd607ba7" returned: 0 in 0.255s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-3a6a74af-716b-4dbe-98a5-750abd607ba7" released by "_delete_snapshot" :: held 1.388s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-ea0d00bd-e816-4ed9-9a35-926f7653daab" released by "delete_snapshot" :: held 1.422s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created reservations ['793c474d-07d6-45d9-9d3f-f17eb4995961', 'a6d0255f-ce9b-43bc-ad0e-59100edf43b4', '0950f594-47e8-49e2-9c70-b3d7c7f4118b', 'de89d855-586d-4917-bb44-512003140c0b'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Delete snapshot completed successfully. Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0aad36a5-20cd-4460-8d02-60e3b9749664 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-3a6a74af-716b-4dbe-98a5-750abd607ba7-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-ea0d00bd-e816-4ed9-9a35-926f7653daab-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-ea0d00bd-e816-4ed9-9a35-926f7653daab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "cinder-quobyte-ea0d00bd-e816-4ed9-9a35-926f7653daab" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-ea0d00bd-e816-4ed9-9a35-926f7653daab" acquired by "delete_volume" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[08753b33-754c-4b86-b1b2-064415d98898]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:03 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab Sep 08 19:17:03 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:03 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab" returned: 0 in 0.352s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:03 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab Sep 08 19:17:03 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:03 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ea0d00bd-e816-4ed9-9a35-926f7653daab" returned: 0 in 0.245s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-quobyte-ea0d00bd-e816-4ed9-9a35-926f7653daab" released by "delete_volume" :: held 0.663s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Created reservations ['ddf872cd-0a41-4b59-8ce7-2ded9f94f1f1', 'cde4c185-6d26-4149-8d02-14dce2bbc1a1', 'bfd7fb63-94fb-4690-8732-02cdeded5993', '529b80a0-1745-4364-9ed3-63108830e60a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:03 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:17:03 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:03 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.265s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:03 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:03 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Deleted volume successfully. Sep 08 19:17:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e644927-09db-4ab1-b3cc-2df3a48550e1 tempest-CreateVolumesFromSnapshotTest-912737369 None] Lock "cinder-ea0d00bd-e816-4ed9-9a35-926f7653daab-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Flow 'volume_create_manager' (05b297b5-724e-4faa-960b-4a5c860f8d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559e9a0e-d0c2-4c2e-902a-10abb625d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559e9a0e-d0c2-4c2e-902a-10abb625d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-21724862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f803bba0-f04a-4260-9ae2-760e8a10153e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16a6ca26c5e466ea989e0c2d4eaa97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:07Z,use_quota=True,user_id='937978e0e753419f9020e04eb9292ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec41ba4-afab-4c89-89d0-ae62b4baf2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec41ba4-afab-4c89-89d0-ae62b4baf2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848ca83-8d15-4f9b-b00b-64dd78a2977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848ca83-8d15-4f9b-b00b-64dd78a2977e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f803bba0-f04a-4260-9ae2-760e8a10153e', 'volume_name': 'volume-f803bba0-f04a-4260-9ae2-760e8a10153e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92802600-f9c8-487c-a3a9-f6d7b983b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92802600-f9c8-487c-a3a9-f6d7b983b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad555e1-8e29-4a5f-86ce-93b17ab2e687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:06 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Volume f803bba0-f04a-4260-9ae2-760e8a10153e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f803bba0-f04a-4260-9ae2-760e8a10153e', 'volume_size': 1} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-21724862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f803bba0-f04a-4260-9ae2-760e8a10153e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16a6ca26c5e466ea989e0c2d4eaa97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:07Z,use_quota=True,user_id='937978e0e753419f9020e04eb9292ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Creating volume f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:06 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:17:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:06 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e 1073741824 Sep 08 19:17:06 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:07 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e 1073741824" returned: 0 in 0.444s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:07 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e Sep 08 19:17:07 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:07 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e" returned: 0 in 0.238s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad555e1-8e29-4a5f-86ce-93b17ab2e687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f803bba0-f04a-4260-9ae2-760e8a10153e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf6d807-618e-42cd-86c5-5d4d04c919d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:07 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Volume volume-f803bba0-f04a-4260-9ae2-760e8a10153e (f803bba0-f04a-4260-9ae2-760e8a10153e): created successfully Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf6d807-618e-42cd-86c5-5d4d04c919d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Flow 'volume_create_manager' (05b297b5-724e-4faa-960b-4a5c860f8d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5d9de7f6-a53c-4c6c-8153-8812c70b0649 tempest-VolumeDependencyTests-1465847267 None] Created volume successfully. Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Creating offline snapshot 8b787032-4db6-46dd-9f9e-1e04ce3864fb of volume f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a581d45-6b38-442e-aca4-84debf027ffb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:08 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e Sep 08 19:17:08 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:08 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e" returned: 0 in 0.370s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:08 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb 1G Sep 08 19:17:08 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:08 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb 1G" returned: 0 in 0.419s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f803bba0-f04a-4260-9ae2-760e8a10153e -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:08 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f803bba0-f04a-4260-9ae2-760e8a10153e -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb Sep 08 19:17:08 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:09 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f803bba0-f04a-4260-9ae2-760e8a10153e -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb" returned: 0 in 0.350s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:09 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb is being set with open permissions: ugo+rw Sep 08 19:17:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:09 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb Sep 08 19:17:09 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:09 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb" returned: 0 in 0.265s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:09 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.info Sep 08 19:17:09 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:09 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.info" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:09 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.info is being set with open permissions: ugo+rw Sep 08 19:17:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:09 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.info Sep 08 19:17:09 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:10 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.info" returned: 0 in 0.259s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-81bc3c57-03b8-4c53-a3de-f1e429fffb23 tempest-VolumeDependencyTests-1465847267 None] Create snapshot completed successfully Sep 08 19:17:11 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-2f38821b-ce52-47c7-9b64-20afefb39761 req-8560b047-e36e-4cf3-a148-cb5d66ae14f7 tempest-TestMinimumBasicScenario-620124998 None] Terminate volume connection completed successfully. Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-2f38821b-ce52-47c7-9b64-20afefb39761 req-8560b047-e36e-4cf3-a148-cb5d66ae14f7 tempest-TestMinimumBasicScenario-620124998 None] Deleting attachment bbce148d-8689-4177-b73a-3ea3b2ee0b6b. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Flow 'volume_create_manager' (295a44bc-1f87-402f-9022-93daba8a6922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd02a31-3811-485a-bbb0-446fd376930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd02a31-3811-485a-bbb0-446fd376930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1892153107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3288554d-4f7d-46c6-bef3-776025638fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16a6ca26c5e466ea989e0c2d4eaa97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b787032-4db6-46dd-9f9e-1e04ce3864fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:12Z,use_quota=True,user_id='937978e0e753419f9020e04eb9292ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626dff6a-afa0-40b5-8ea9-7164b5e69b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626dff6a-afa0-40b5-8ea9-7164b5e69b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3eed26e-9daf-4334-a188-ab08d734e67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3eed26e-9daf-4334-a188-ab08d734e67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3288554d-4f7d-46c6-bef3-776025638fc8', 'volume_name': 'volume-3288554d-4f7d-46c6-bef3-776025638fc8', 'volume_size': 1, 'snapshot_id': '8b787032-4db6-46dd-9f9e-1e04ce3864fb'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a35e4a8-ffb3-41fc-bcd7-ecde44f2f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a35e4a8-ffb3-41fc-bcd7-ecde44f2f124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad17611f-9a33-42da-8364-500740d9c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:11 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Volume 3288554d-4f7d-46c6-bef3-776025638fc8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3288554d-4f7d-46c6-bef3-776025638fc8', 'volume_size': 1, 'snapshot_id': '8b787032-4db6-46dd-9f9e-1e04ce3864fb'} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-quobyte-8b787032-4db6-46dd-9f9e-1e04ce3864fb-3288554d-4f7d-46c6-bef3-776025638fc8" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-8b787032-4db6-46dd-9f9e-1e04ce3864fb-3288554d-4f7d-46c6-bef3-776025638fc8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Creating volume 3288554d-4f7d-46c6-bef3-776025638fc8 from snapshot 8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-quobyte-3288554d-4f7d-46c6-bef3-776025638fc8" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-3288554d-4f7d-46c6-bef3-776025638fc8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] snapshot: 8b787032-4db6-46dd-9f9e-1e04ce3864fb, volume: 3288554d-4f7d-46c6-bef3-776025638fc8, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a0de2e-b6f8-4b7a-ad6a-2b03084bf1a5]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Acquiring lock "cinder-42cf8687-5616-44eb-be96-123b349f8688-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Lock "cinder-42cf8687-5616-44eb-be96-123b349f8688-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Acquiring lock "cinder-quobyte-42cf8687-5616-44eb-be96-123b349f8688" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Lock "cinder-quobyte-42cf8687-5616-44eb-be96-123b349f8688" acquired by "delete_volume" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:12 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb Sep 08 19:17:12 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6204b069-8386-4082-9558-9e8b3597333c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:12 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 Sep 08 19:17:12 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:12 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb" returned: 0 in 0.382s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f803bba0-f04a-4260-9ae2-760e8a10153e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676daee-50b6-4107-985f-817c6cfb6cbe]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:12 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e Sep 08 19:17:12 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:12 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688" returned: 0 in 0.380s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:12 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688 Sep 08 19:17:12 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:12 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:12 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-42cf8687-5616-44eb-be96-123b349f8688" returned: 0 in 0.251s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e" returned: 0 in 0.390s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Lock "cinder-quobyte-42cf8687-5616-44eb-be96-123b349f8688" released by "delete_volume" :: held 0.681s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:12 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 Sep 08 19:17:12 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Created reservations ['169f2763-3e11-4603-8154-e64f9a79f21b', 'ca5dbb80-97b5-4a6d-830d-7edf563d8894', '190173d2-efed-4de4-ad34-0f9c9f7fa593', '7c713620-c42c-4789-81c6-107baf8ab363'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:12 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:17:12 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:13 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.257s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:13 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:13 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Deleted volume successfully. Sep 08 19:17:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8010177f-d893-4379-9746-0686b1c581cb tempest-TestMinimumBasicScenario-620124998 None] Lock "cinder-42cf8687-5616-44eb-be96-123b349f8688-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:18 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8" returned: 0 in 5.414s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:17:18 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Converted 1024.00 MB image at 189.10 MB/s Sep 08 19:17:18 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 is being set with open permissions: ugo+rw Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:18 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 Sep 08 19:17:18 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:18 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8" returned: 0 in 0.268s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-3288554d-4f7d-46c6-bef3-776025638fc8" released by "_copy_volume_from_snapshot" :: held 6.543s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-8b787032-4db6-46dd-9f9e-1e04ce3864fb-3288554d-4f7d-46c6-bef3-776025638fc8" released by "_create_volume_from_snapshot" :: held 6.646s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.664s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad17611f-9a33-42da-8364-500740d9c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3288554d-4f7d-46c6-bef3-776025638fc8', 'volume_size': 1, 'snapshot_id': '8b787032-4db6-46dd-9f9e-1e04ce3864fb'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d505d7d4-86a1-4cd5-bfe1-c94ad080f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:18 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Volume volume-3288554d-4f7d-46c6-bef3-776025638fc8 (3288554d-4f7d-46c6-bef3-776025638fc8): created successfully Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d505d7d4-86a1-4cd5-bfe1-c94ad080f175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:18 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Flow 'volume_create_manager' (295a44bc-1f87-402f-9022-93daba8a6922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:18 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5bf473d3-fcb2-4f8c-be43-9666ad307a72 tempest-VolumeDependencyTests-1465847267 None] Created volume successfully. Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-8b787032-4db6-46dd-9f9e-1e04ce3864fb-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-8b787032-4db6-46dd-9f9e-1e04ce3864fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-quobyte-f803bba0-f04a-4260-9ae2-760e8a10153e" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-f803bba0-f04a-4260-9ae2-760e8a10153e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-quobyte-8b787032-4db6-46dd-9f9e-1e04ce3864fb" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-8b787032-4db6-46dd-9f9e-1e04ce3864fb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Deleting offline snapshot 8b787032-4db6-46dd-9f9e-1e04ce3864fb of volume f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] snapshot_file for this snap is: volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec9b5b2-a772-4b38-bbf5-090211ea8ca6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:19 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb Sep 08 19:17:19 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:20 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb" returned: 0 in 0.362s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f803bba0-f04a-4260-9ae2-760e8a10153e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:17:20 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[72088965-a607-4e06-8306-a474888f9e8e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:20 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e Sep 08 19:17:20 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:20 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e" returned: 0 in 0.553s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:20 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb Sep 08 19:17:20 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:21 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb" returned: 0 in 0.340s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:21 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb Sep 08 19:17:21 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:21 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e.8b787032-4db6-46dd-9f9e-1e04ce3864fb" returned: 0 in 0.262s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-8b787032-4db6-46dd-9f9e-1e04ce3864fb" released by "_delete_snapshot" :: held 1.629s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-f803bba0-f04a-4260-9ae2-760e8a10153e" released by "delete_snapshot" :: held 1.657s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Created reservations ['96d33235-7bf2-4e75-9856-bba16596be2b', 'f52aa5bf-1a56-4798-b17b-36d74c29c394', 'ad798a86-412e-4283-a4eb-64fa8e27e35d', 'ac8090bd-5138-41dc-8462-32298475bee4'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:21 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Delete snapshot completed successfully. Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a6c77b97-c2aa-4446-99e0-441142049247 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-8b787032-4db6-46dd-9f9e-1e04ce3864fb-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-f803bba0-f04a-4260-9ae2-760e8a10153e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-f803bba0-f04a-4260-9ae2-760e8a10153e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-quobyte-f803bba0-f04a-4260-9ae2-760e8a10153e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-f803bba0-f04a-4260-9ae2-760e8a10153e" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf43297f-9ffd-4372-bba1-0eb5b07b59cb]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:22 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e Sep 08 19:17:22 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:22 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e" returned: 0 in 0.367s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:22 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e Sep 08 19:17:22 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:22 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f803bba0-f04a-4260-9ae2-760e8a10153e" returned: 0 in 0.250s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-f803bba0-f04a-4260-9ae2-760e8a10153e" released by "delete_volume" :: held 0.688s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Created reservations ['672c4c96-a177-462b-b8aa-a7194142ff9e', 'ca1548dd-28df-413b-944a-6a81a8676b7d', '7c722323-53d5-47e9-bb87-fe76d4cf39c8', '86fb3c64-2ee4-4a03-917c-f367ee1310b8'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:22 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:17:22 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:23 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.268s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Deleted volume successfully. Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-3288554d-4f7d-46c6-bef3-776025638fc8-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-4b1c97c3-a999-4d80-9c16-7b677db0fd47 tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-f803bba0-f04a-4260-9ae2-760e8a10153e-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-3288554d-4f7d-46c6-bef3-776025638fc8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "cinder-quobyte-3288554d-4f7d-46c6-bef3-776025638fc8" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-3288554d-4f7d-46c6-bef3-776025638fc8" acquired by "delete_volume" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e41abc-5674-4044-99e5-1c75ced83633]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:23 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 Sep 08 19:17:23 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:23 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:23 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8 Sep 08 19:17:23 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:23 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3288554d-4f7d-46c6-bef3-776025638fc8" returned: 0 in 0.259s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-quobyte-3288554d-4f7d-46c6-bef3-776025638fc8" released by "delete_volume" :: held 0.705s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Created reservations ['07267c28-6406-487b-8999-27f7b4a85a10', 'fc398513-8917-4044-ad9d-bc65f83f85cf', '3b5ba773-ca21-4dd4-9887-308eda2aea75', 'b4062e34-9b26-445d-a3ea-7c482dccb007'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:24 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:17:24 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:24 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.287s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:24 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Deleted volume successfully. Sep 08 19:17:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3a5e5689-43d7-439f-b1f0-691b460aa9cc tempest-VolumeDependencyTests-1465847267 None] Lock "cinder-3288554d-4f7d-46c6-bef3-776025638fc8-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:34 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:17:34 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:34 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.250s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:17:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:17:36 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:DELETE=6,cinder:UPDATE=93,cinder:SELECT=74,cinder:INSERT=28 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:17:36 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=104,cinder:DELETE=10,cinder:SELECT=64,cinder:INSERT=22 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Flow 'volume_create_manager' (0ee63374-1f79-4c42-9405-02831fdcefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca9dab1-96b7-4ca1-a827-fc873bf5af9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca9dab1-96b7-4ca1-a827-fc873bf5af9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2015392324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d4a35e-209e-493d-b4af-e91282b96618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d193bcb1a562414d89cbedeeabbf4b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:52Z,use_quota=True,user_id='d2d6b9609ba74e4c9e27892c1ef33359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d430a74-2c58-44d8-8fed-244a9c2dd8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d430a74-2c58-44d8-8fed-244a9c2dd8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbc562b-2ba6-4396-b0ab-3469dfac45d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbc562b-2ba6-4396-b0ab-3469dfac45d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96d4a35e-209e-493d-b4af-e91282b96618', 'volume_name': 'volume-96d4a35e-209e-493d-b4af-e91282b96618', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7181e810-bc93-45eb-92d9-1a104f7b2814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7181e810-bc93-45eb-92d9-1a104f7b2814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6096609d-c513-4756-aad3-46e3eee4719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Volume 96d4a35e-209e-493d-b4af-e91282b96618: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96d4a35e-209e-493d-b4af-e91282b96618', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Trying to clone 96d4a35e-209e-493d-b4af-e91282b96618 from image 8499e13e-f314-4011-953c-7c51abb2061c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:17:52 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4d06e-7380-48ea-9757-f3b57eca9d5d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:52 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD Sep 08 19:17:52 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:52 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c is fetched for user d2d6b9609ba74e4c9e27892c1ef33359. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5481fac1-7a8b-43bc-b7c7-c75d9c5f3bbd]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:52 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD Sep 08 19:17:52 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:53 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2015392324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d4a35e-209e-493d-b4af-e91282b96618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d193bcb1a562414d89cbedeeabbf4b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:52Z,use_quota=True,user_id='d2d6b9609ba74e4c9e27892c1ef33359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Creating volume 96d4a35e-209e-493d-b4af-e91282b96618 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:53 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:53 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 1073741824 Sep 08 19:17:53 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:53 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 1073741824" returned: 0 in 0.381s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:53 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 Sep 08 19:17:53 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:53 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618" returned: 0 in 0.235s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Attempting download of 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 96d4a35e-209e-493d-b4af-e91282b96618. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[531bdeb9-4fc9-46c2-ab40-db16621faf13]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_bho00xvn {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:54 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_bho00xvn Sep 08 19:17:54 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:54 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_bho00xvn" returned: 0 in 0.327s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_bho00xvn {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:54 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_bho00xvn Sep 08 19:17:54 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:54 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_bho00xvn" returned: 1 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8499e13e-f314-4011-953c-7c51abb2061c_bho00xvn' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f015ffc9-749e-4676-8918-fc671a362da8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:54 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD Sep 08 19:17:54 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:54 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] 8499e13e-f314-4011-953c-7c51abb2061c was qcow2, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:17:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:54 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 Sep 08 19:17:54 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:56 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618" returned: 0 in 1.538s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8499e13e-f314-4011-953c-7c51abb2061c_3sbpdteudevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:17:56 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Converted 112.00 MB image at 72.77 MB/s Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:56 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 1G Sep 08 19:17:56 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:56 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 1G" returned: 0 in 0.306s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Downloaded image 8499e13e-f314-4011-953c-7c51abb2061c ((None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}])) to volume 96d4a35e-209e-493d-b4af-e91282b96618 successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Temporary image 8499e13e-f314-4011-953c-7c51abb2061c for user d2d6b9609ba74e4c9e27892c1ef33359 is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Marking volume 96d4a35e-209e-493d-b4af-e91282b96618 as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Copying metadata from image 8499e13e-f314-4011-953c-7c51abb2061c to 96d4a35e-209e-493d-b4af-e91282b96618. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Creating volume glance metadata for volume 96d4a35e-209e-493d-b4af-e91282b96618 backed by image 8499e13e-f314-4011-953c-7c51abb2061c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6096609d-c513-4756-aad3-46e3eee4719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d4a35e-209e-493d-b4af-e91282b96618', 'volume_size': 1, 'image_id': '8499e13e-f314-4011-953c-7c51abb2061c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8499e13e-f314-4011-953c-7c51abb2061c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5f5a40434f544f7ab6d868fe79f8c725', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8499e13e-f314-4011-953c-7c51abb2061c', 'created_at': datetime.datetime(2026, 9, 8, 16, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 16, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8499e13e-f314-4011-953c-7c51abb2061c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de1e8a1-632d-4094-9a15-23a914289d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:56 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Volume volume-96d4a35e-209e-493d-b4af-e91282b96618 (96d4a35e-209e-493d-b4af-e91282b96618): created successfully Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de1e8a1-632d-4094-9a15-23a914289d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:56 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Flow 'volume_create_manager' (0ee63374-1f79-4c42-9405-02831fdcefda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b4a097ac-f2a8-4075-a3b7-b8c6c78e4a9c tempest-TestShelveInstance-1099500713 None] Created volume successfully. Sep 08 19:17:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-5def213d-fc44-4995-960e-71eac2390239 req-69b8c712-3d3c-4e6e-96fb-b73c31b278fc tempest-TestShelveInstance-1099500713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-5def213d-fc44-4995-960e-71eac2390239 req-69b8c712-3d3c-4e6e-96fb-b73c31b278fc tempest-TestShelveInstance-1099500713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-5def213d-fc44-4995-960e-71eac2390239 req-69b8c712-3d3c-4e6e-96fb-b73c31b278fc tempest-TestShelveInstance-1099500713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:59 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-5def213d-fc44-4995-960e-71eac2390239 req-69b8c712-3d3c-4e6e-96fb-b73c31b278fc tempest-TestShelveInstance-1099500713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-96d4a35e-209e-493d-b4af-e91282b96618', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1c1b079-1d14-44bc-8b8a-7932bdf42dd3', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:17:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-5def213d-fc44-4995-960e-71eac2390239 req-69b8c712-3d3c-4e6e-96fb-b73c31b278fc tempest-TestShelveInstance-1099500713 None] attachment_update completed successfully. Sep 08 19:18:09 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=8 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:09 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-3b567cd8-a134-4039-9053-9071bf56b373 req-bc7c7553-044a-4224-8bea-9853b96d695c tempest-TestShelveInstance-1099500713 None] Terminate volume connection completed successfully. Sep 08 19:18:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-3b567cd8-a134-4039-9053-9071bf56b373 req-bc7c7553-044a-4224-8bea-9853b96d695c tempest-TestShelveInstance-1099500713 None] Deleting attachment d1c1b079-1d14-44bc-8b8a-7932bdf42dd3. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:18:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-c7e16785-d41d-46a9-98a8-986fa162ea1f req-2febb6de-f8a1-4b94-8c84-b5190ba3928b tempest-TestShelveInstance-1099500713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-c7e16785-d41d-46a9-98a8-986fa162ea1f req-2febb6de-f8a1-4b94-8c84-b5190ba3928b tempest-TestShelveInstance-1099500713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-c7e16785-d41d-46a9-98a8-986fa162ea1f req-2febb6de-f8a1-4b94-8c84-b5190ba3928b tempest-TestShelveInstance-1099500713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-c7e16785-d41d-46a9-98a8-986fa162ea1f req-2febb6de-f8a1-4b94-8c84-b5190ba3928b tempest-TestShelveInstance-1099500713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a', 'name': 'volume-96d4a35e-209e-493d-b4af-e91282b96618', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55f00efe-2a3d-4c02-bfb6-8e95e4a449c5', 'enforce_multipath': True} {{(pid=87538) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:18:30 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-c7e16785-d41d-46a9-98a8-986fa162ea1f req-2febb6de-f8a1-4b94-8c84-b5190ba3928b tempest-TestShelveInstance-1099500713 None] attachment_update completed successfully. Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:34 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:18:34 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:34 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.330s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:18:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:18:40 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=10 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:40 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-6f1e497b-1d73-423b-b258-37f4dba0504e tempest-TestShelveInstance-1099500713 None] Terminate volume connection completed successfully. Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-6f1e497b-1d73-423b-b258-37f4dba0504e tempest-TestShelveInstance-1099500713 None] Deleting attachment 55f00efe-2a3d-4c02-bfb6-8e95e4a449c5. {{(pid=87538) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Acquiring lock "cinder-96d4a35e-209e-493d-b4af-e91282b96618-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Lock "cinder-96d4a35e-209e-493d-b4af-e91282b96618-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Acquiring lock "cinder-quobyte-96d4a35e-209e-493d-b4af-e91282b96618" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Lock "cinder-quobyte-96d4a35e-209e-493d-b4af-e91282b96618" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef2ea99-78cd-439c-ae81-ed7d79382c82]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:58 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 Sep 08 19:18:58 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:58 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618" returned: 0 in 0.370s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:58 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618 Sep 08 19:18:58 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:58 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-96d4a35e-209e-493d-b4af-e91282b96618" returned: 0 in 0.246s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Lock "cinder-quobyte-96d4a35e-209e-493d-b4af-e91282b96618" released by "delete_volume" :: held 0.660s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG cinder.quota [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Created reservations ['39526975-37f1-4403-bc3e-71f59be3f03a', 'e747412e-f095-4c81-8c6b-bcdebe922e7b', '1804da40-7885-4b6e-b505-496d268b0e56', 'ebff511c-9cb0-4935-b373-a869834f7667'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:59 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:18:59 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:59 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.233s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG cinder.manager [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:59 devstack cinder-volume[87538]: INFO cinder.volume.manager [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Deleted volume successfully. Sep 08 19:18:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [req-49e5ff25-b253-42fc-abbb-7ac731927629 req-0e36a85d-5a41-4d08-9ff9-9b71cb5228aa tempest-TestShelveInstance-1099500713 None] Lock "cinder-96d4a35e-209e-493d-b4af-e91282b96618-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:09 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:19:09 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (b6823284-c7d5-4b8c-810a-188fdedeba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a814fb1f-9419-4297-ab5b-debe9adb3eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a814fb1f-9419-4297-ab5b-debe9adb3eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820229998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfc043d-fda0-478c-bf90-cd28c752d84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:28Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b8033c-38ab-44b7-8978-d85865f21c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b8033c-38ab-44b7-8978-d85865f21c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a625654d-db19-4998-991d-1bf2e14c3376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a625654d-db19-4998-991d-1bf2e14c3376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abfc043d-fda0-478c-bf90-cd28c752d84b', 'volume_name': 'volume-abfc043d-fda0-478c-bf90-cd28c752d84b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2756940-c19f-44e9-bc47-c0d16e5b7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2756940-c19f-44e9-bc47-c0d16e5b7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b72dd8-0ff0-427f-875f-e35a007747b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume abfc043d-fda0-478c-bf90-cd28c752d84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abfc043d-fda0-478c-bf90-cd28c752d84b', 'volume_size': 1} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820229998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfc043d-fda0-478c-bf90-cd28c752d84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:28Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Creating volume abfc043d-fda0-478c-bf90-cd28c752d84b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:27 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:27 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b 1073741824 Sep 08 19:19:27 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (8bb5c28d-d270-4169-8bfb-e3534339dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bac3d9-d536-4f31-a990-6faa6bdfc248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bac3d9-d536-4f31-a990-6faa6bdfc248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234964821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97366387-9af8-47bd-a824-04278d062500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:28Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8869771c-668d-49b8-b62f-8c53cab7b6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8869771c-668d-49b8-b62f-8c53cab7b6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a2a583-e7e0-485c-8616-b8071977ad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a2a583-e7e0-485c-8616-b8071977ad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97366387-9af8-47bd-a824-04278d062500', 'volume_name': 'volume-97366387-9af8-47bd-a824-04278d062500', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e6e012-910d-45e2-9b64-dae921e390fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e6e012-910d-45e2-9b64-dae921e390fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc7d29f-fc59-47e0-b537-43237264f7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Volume 97366387-9af8-47bd-a824-04278d062500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97366387-9af8-47bd-a824-04278d062500', 'volume_size': 1} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (b9ac8a34-1705-430d-aa3f-2b719a75729d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda16983-8c9e-4114-befa-115af4b37ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda16983-8c9e-4114-befa-115af4b37ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337562576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a060d2-3967-436d-9e1b-e6f7fb7fa93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:28Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde57fc-3b72-4444-b7ff-47bfc161eee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde57fc-3b72-4444-b7ff-47bfc161eee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d1b358-9938-4a40-bd63-eadc28e8921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d1b358-9938-4a40-bd63-eadc28e8921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a060d2-3967-436d-9e1b-e6f7fb7fa93f', 'volume_name': 'volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e24ff4-dce9-490b-b33b-e450e890eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e24ff4-dce9-490b-b33b-e450e890eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498891bd-e8be-4b67-95f5-a5b756e5664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Volume 03a060d2-3967-436d-9e1b-e6f7fb7fa93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f', 'volume_size': 1} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b 1073741824" returned: 0 in 0.853s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:28 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b Sep 08 19:19:28 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:29 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b" returned: 0 in 0.369s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234964821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97366387-9af8-47bd-a824-04278d062500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:28Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Creating volume 97366387-9af8-47bd-a824-04278d062500 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:29 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:29 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 1073741824 Sep 08 19:19:29 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b72dd8-0ff0-427f-875f-e35a007747b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abfc043d-fda0-478c-bf90-cd28c752d84b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eec9321-94bb-42f2-8401-23a303ab6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume volume-abfc043d-fda0-478c-bf90-cd28c752d84b (abfc043d-fda0-478c-bf90-cd28c752d84b): created successfully Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eec9321-94bb-42f2-8401-23a303ab6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (b6823284-c7d5-4b8c-810a-188fdedeba97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (ae70fe2d-4c05-4fe4-ae51-1cb162394ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a658f41d-5a85-4504-9b3d-35141b5fc694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f977c885-db0a-486d-ad0b-b469aef4c906 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created volume successfully. Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a658f41d-5a85-4504-9b3d-35141b5fc694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1789978211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec31c066-ea21-4341-a9cb-c5ee4bd6862f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:29Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c71e56-10e5-43e4-b811-f858f10b7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c71e56-10e5-43e4-b811-f858f10b7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f15a709-e5eb-4a03-97f8-30817df8874a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f15a709-e5eb-4a03-97f8-30817df8874a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec31c066-ea21-4341-a9cb-c5ee4bd6862f', 'volume_name': 'volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8253cef-1d69-426d-80e1-21e48eb01a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8253cef-1d69-426d-80e1-21e48eb01a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff023b62-1a2a-4af6-9f69-4320cc18e50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Volume ec31c066-ea21-4341-a9cb-c5ee4bd6862f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f', 'volume_size': 1} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (32dc2cca-8d3e-4d8b-ad3b-5feeb8d2d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cde1074-3d57-4027-a080-49551956b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cde1074-3d57-4027-a080-49551956b222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413962611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed2598f-2803-43b6-b6ca-54948437c1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:30Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f906ac4c-e900-42b6-825f-69331c68f5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f906ac4c-e900-42b6-825f-69331c68f5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2c2a66-232b-435c-a648-568512fca6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2c2a66-232b-435c-a648-568512fca6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed2598f-2803-43b6-b6ca-54948437c1a8', 'volume_name': 'volume-5ed2598f-2803-43b6-b6ca-54948437c1a8', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dadf102-f32b-4616-ab6b-4469bf89c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dadf102-f32b-4616-ab6b-4469bf89c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0597f0-d0d5-42bc-a119-2ce48a1982cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:29 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Volume 5ed2598f-2803-43b6-b6ca-54948437c1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed2598f-2803-43b6-b6ca-54948437c1a8', 'volume_size': 1} Sep 08 19:19:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:30 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 1073741824" returned: 0 in 0.884s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:30 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 Sep 08 19:19:30 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (b916f34c-57c0-4d3e-8165-810ac3b54b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7141f6-dce9-425b-8ce5-05f1d469ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7141f6-dce9-425b-8ce5-05f1d469ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-343527515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327c9317-4753-42c8-8ce4-5acc9447baad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:30Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660d0728-37af-4d93-b5d7-c062dc36cb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660d0728-37af-4d93-b5d7-c062dc36cb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0ed0de-1f44-4526-a2c1-4f1dfd3d48cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0ed0de-1f44-4526-a2c1-4f1dfd3d48cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327c9317-4753-42c8-8ce4-5acc9447baad', 'volume_name': 'volume-327c9317-4753-42c8-8ce4-5acc9447baad', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c5d62c-3c11-449a-ac94-19958e4c0a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c5d62c-3c11-449a-ac94-19958e4c0a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f9756a-a661-4d86-b512-467ade30aee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Volume 327c9317-4753-42c8-8ce4-5acc9447baad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327c9317-4753-42c8-8ce4-5acc9447baad', 'volume_size': 1} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:30 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500" returned: 0 in 0.469s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337562576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a060d2-3967-436d-9e1b-e6f7fb7fa93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:28Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Creating volume 03a060d2-3967-436d-9e1b-e6f7fb7fa93f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:30 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:30 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f 1073741824 Sep 08 19:19:30 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc7d29f-fc59-47e0-b537-43237264f7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97366387-9af8-47bd-a824-04278d062500', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9ea11a-3e5a-457f-b168-e42b1ac33910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (e8cd628e-94ae-4af4-b003-2df8601721bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4150835-a98b-4d3f-8352-2041ebf4ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Volume volume-97366387-9af8-47bd-a824-04278d062500 (97366387-9af8-47bd-a824-04278d062500): created successfully Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9ea11a-3e5a-457f-b168-e42b1ac33910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (8bb5c28d-d270-4169-8bfb-e3534339dea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4150835-a98b-4d3f-8352-2041ebf4ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818476972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bcf37c-8602-486f-a5d0-aa708643bc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:31Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474dbbea-ad53-4193-b9a5-e219549228ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474dbbea-ad53-4193-b9a5-e219549228ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4786b3-bd0d-4257-8155-636a43c43b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4786b3-bd0d-4257-8155-636a43c43b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77bcf37c-8602-486f-a5d0-aa708643bc79', 'volume_name': 'volume-77bcf37c-8602-486f-a5d0-aa708643bc79', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e21cdc7-5965-407e-ad55-3f56986dd6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e21cdc7-5965-407e-ad55-3f56986dd6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b45b27-8142-41a9-ba69-d00d852aa17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:30 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume 77bcf37c-8602-486f-a5d0-aa708643bc79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77bcf37c-8602-486f-a5d0-aa708643bc79', 'volume_size': 1} Sep 08 19:19:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:30 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bd3ed9ab-5ba1-4c02-a351-b38700fce55c tempest-CreateVolumesFromImageTest-1286339078 None] Created volume successfully. Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (d9b85b35-a2be-45f0-91be-fea5de71fa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f751e69e-0111-46e0-8c81-c4079156d96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f751e69e-0111-46e0-8c81-c4079156d96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-182379198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa655c3-26fe-47a0-8a2a-a022de03e00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:31Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7974e842-b218-48ed-92ad-9f38f94023e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7974e842-b218-48ed-92ad-9f38f94023e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329aa6c4-2ff7-4bae-9ae4-c8c9cc24e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329aa6c4-2ff7-4bae-9ae4-c8c9cc24e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa655c3-26fe-47a0-8a2a-a022de03e00b', 'volume_name': 'volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cf59f0-4608-4ba3-8dca-3a7b9800efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cf59f0-4608-4ba3-8dca-3a7b9800efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d691e24c-4585-4d40-b584-d4a667698b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume 7fa655c3-26fe-47a0-8a2a-a022de03e00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b', 'volume_size': 1} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:31 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f 1073741824" returned: 0 in 0.839s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:31 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f Sep 08 19:19:31 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (68f38c36-e897-4add-84c8-ea249cfa9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07e25e2-0016-4159-86d5-725f15a68b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07e25e2-0016-4159-86d5-725f15a68b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301466364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929deba2-4941-46d8-bfb5-5264291bbf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:31Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bddda12-543d-4e0f-bd45-fc504c48f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bddda12-543d-4e0f-bd45-fc504c48f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe8cc10-59d1-4bb9-b940-59d4a2b0d32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe8cc10-59d1-4bb9-b940-59d4a2b0d32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929deba2-4941-46d8-bfb5-5264291bbf0c', 'volume_name': 'volume-929deba2-4941-46d8-bfb5-5264291bbf0c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14bf49f-8170-4824-9ef6-e7e406232312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14bf49f-8170-4824-9ef6-e7e406232312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9f77eb-1b9b-489b-be88-1a57a8910141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume 929deba2-4941-46d8-bfb5-5264291bbf0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929deba2-4941-46d8-bfb5-5264291bbf0c', 'volume_size': 1} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:31 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f" returned: 0 in 0.403s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.495s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1789978211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec31c066-ea21-4341-a9cb-c5ee4bd6862f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:29Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Creating volume ec31c066-ea21-4341-a9cb-c5ee4bd6862f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:31 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498891bd-e8be-4b67-95f5-a5b756e5664e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:31 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f 1073741824 Sep 08 19:19:31 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dd8a54-6b8d-4152-8eb1-81f6428fd193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:31 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (5b7e4b5b-aed9-4c14-a119-b592fc05b0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551e0149-07a2-4793-93de-650e688ed034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Volume volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f (03a060d2-3967-436d-9e1b-e6f7fb7fa93f): created successfully Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69dd8a54-6b8d-4152-8eb1-81f6428fd193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (b9ac8a34-1705-430d-aa3f-2b719a75729d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (551e0149-07a2-4793-93de-650e688ed034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988333034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e473f59-4681-485e-b4d7-5f5cf98d59cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:32Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a1df63-3e8f-46ae-b76a-a6430534896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a1df63-3e8f-46ae-b76a-a6430534896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9766af-afca-4076-95c2-7a2905083698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9766af-afca-4076-95c2-7a2905083698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e473f59-4681-485e-b4d7-5f5cf98d59cf', 'volume_name': 'volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0bb3dc-5325-4b41-9167-d2fecd756865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0bb3dc-5325-4b41-9167-d2fecd756865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f2c12a-f022-4854-b474-75ce8ef57f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume 0e473f59-4681-485e-b4d7-5f5cf98d59cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf', 'volume_size': 1} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9bd0d68d-c701-404c-81ff-0df78da15568 tempest-CreateVolumesFromImageTest-1286339078 None] Created volume successfully. Sep 08 19:19:32 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f 1073741824" returned: 0 in 0.714s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (d6c2839a-4950-4c8a-8b7a-02c39126cb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf64e51-e815-40f2-b987-c59a6a7ea269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf64e51-e815-40f2-b987-c59a6a7ea269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-318838696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de4974c-0d1c-4884-86ae-e765e7e909e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:33Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7961f426-6e23-40e1-a762-4c3a48d25925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7961f426-6e23-40e1-a762-4c3a48d25925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f419b72-916e-4241-aa48-2393fb7c8f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f419b72-916e-4241-aa48-2393fb7c8f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de4974c-0d1c-4884-86ae-e765e7e909e7', 'volume_name': 'volume-9de4974c-0d1c-4884-86ae-e765e7e909e7', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9153de45-2915-487a-97b8-4b14cb5c132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9153de45-2915-487a-97b8-4b14cb5c132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f385bd-433e-4373-9b90-86c22c477ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:32 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume 9de4974c-0d1c-4884-86ae-e765e7e909e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de4974c-0d1c-4884-86ae-e765e7e909e7', 'volume_size': 1} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:32 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f Sep 08 19:19:32 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:33 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f" returned: 0 in 0.291s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.300s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413962611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed2598f-2803-43b6-b6ca-54948437c1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:30Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Creating volume 5ed2598f-2803-43b6-b6ca-54948437c1a8 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:33 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff023b62-1a2a-4af6-9f69-4320cc18e50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cb64eb-3966-4e2b-ba24-e1a9c0aaca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:33 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 1073741824 Sep 08 19:19:33 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:33 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Volume volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f (ec31c066-ea21-4341-a9cb-c5ee4bd6862f): created successfully Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6cb64eb-3966-4e2b-ba24-e1a9c0aaca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (ae70fe2d-4c05-4fe4-ae51-1cb162394ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:33 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c7809ca8-432f-4593-bda8-47174264a895 tempest-CreateVolumesFromImageTest-1286339078 None] Created volume successfully. Sep 08 19:19:33 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 1073741824" returned: 0 in 0.581s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Flow 'volume_create_manager' (0b7a571a-41ff-4e0e-b3e5-774d600cbe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a6da08-8e29-4b47-870b-3f808d285d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a6da08-8e29-4b47-870b-3f808d285d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a837412-5ca8-45a5-b3f6-a9bfdea567fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8cb4c8b73146a6996b4286ac24a9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:34Z,use_quota=True,user_id='6c2a975532a4419ab577664f9fe4b41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(589a396c-29e3-49d5-8bc5-643036fb0f93),volume_type_id=589a396c-29e3-49d5-8bc5-643036fb0f93)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceef4d4-e60a-449f-8e75-f9902d08bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceef4d4-e60a-449f-8e75-f9902d08bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e0526d-725e-45b3-ba76-2b5030ed0682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:19:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:33 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 Sep 08 19:19:33 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:34 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-343527515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327c9317-4753-42c8-8ce4-5acc9447baad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa83609000d46f383dac75b8c4b0870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:30Z,use_quota=True,user_id='f5ff9b2c63374a4d9b75ef219964a255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Creating volume 327c9317-4753-42c8-8ce4-5acc9447baad {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:34 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0597f0-d0d5-42bc-a119-2ce48a1982cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed2598f-2803-43b6-b6ca-54948437c1a8', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7b7ed4-bb1a-4c35-a641-57023dff94c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:34 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad 1073741824 Sep 08 19:19:34 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Volume volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 (5ed2598f-2803-43b6-b6ca-54948437c1a8): created successfully Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7b7ed4-bb1a-4c35-a641-57023dff94c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (32dc2cca-8d3e-4d8b-ad3b-5feeb8d2d802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9e7bc5fc-014f-4a36-9ca7-546a3c3c6479 tempest-CreateVolumesFromImageTest-1286339078 None] Created volume successfully. Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e0526d-725e-45b3-ba76-2b5030ed0682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a837412-5ca8-45a5-b3f6-a9bfdea567fc', 'volume_name': 'volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc', 'volume_size': 1, 'image_id': '11837121-fd99-448b-9c98-001a1947d358', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11837121-fd99-448b-9c98-001a1947d358', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a6821c2aebee95d82e0191f2a262365', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e8cb4c8b73146a6996b4286ac24a9ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '53c5c08ab0004fbb031add7a8d6eb08868fda5a486c9b6f533547b3857d69644f72ae1e57235605ffe89555c858e1e34b9c711d5b113e710ca6a5cf2e67ef7d1', 'id': '11837121-fd99-448b-9c98-001a1947d358', 'created_at': datetime.datetime(2026, 9, 8, 17, 19, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 19, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11837121-fd99-448b-9c98-001a1947d358/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d42832-ded4-43cf-b949-4db6127ab268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d42832-ded4-43cf-b949-4db6127ab268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58063a3c-3f69-4175-a178-83ec7147a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:34 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Volume 2a837412-5ca8-45a5-b3f6-a9bfdea567fc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc', 'volume_size': 1, 'image_id': '11837121-fd99-448b-9c98-001a1947d358', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11837121-fd99-448b-9c98-001a1947d358', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a6821c2aebee95d82e0191f2a262365', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e8cb4c8b73146a6996b4286ac24a9ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '53c5c08ab0004fbb031add7a8d6eb08868fda5a486c9b6f533547b3857d69644f72ae1e57235605ffe89555c858e1e34b9c711d5b113e710ca6a5cf2e67ef7d1', 'id': '11837121-fd99-448b-9c98-001a1947d358', 'created_at': datetime.datetime(2026, 9, 8, 17, 19, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 19, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11837121-fd99-448b-9c98-001a1947d358/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Trying to clone 2a837412-5ca8-45a5-b3f6-a9bfdea567fc from image 11837121-fd99-448b-9c98-001a1947d358 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11837121-fd99-448b-9c98-001a1947d358', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:19:34 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:19:34 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:34 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9812ee34-269d-4d6e-8892-d23b35f5091f]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:34 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD Sep 08 19:19:34 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:34 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad 1073741824" returned: 0 in 0.546s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:34 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad Sep 08 19:19:34 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:34 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.459s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:19:34 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.064s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818476972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bcf37c-8602-486f-a5d0-aa708643bc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:31Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Creating volume 77bcf37c-8602-486f-a5d0-aa708643bc79 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:35 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:35 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:35 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 1073741824 Sep 08 19:19:35 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f9756a-a661-4d86-b512-467ade30aee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327c9317-4753-42c8-8ce4-5acc9447baad', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75791259-61f3-4cca-a810-26abc696adc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Volume volume-327c9317-4753-42c8-8ce4-5acc9447baad (327c9317-4753-42c8-8ce4-5acc9447baad): created successfully Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75791259-61f3-4cca-a810-26abc696adc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Flow 'volume_create_manager' (b916f34c-57c0-4d3e-8165-810ac3b54b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-991dd09c-2de5-40d0-9a08-5b24cbdf028a tempest-CreateVolumesFromImageTest-1286339078 None] Created volume successfully. Sep 08 19:19:35 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD Sep 08 19:19:35 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:35 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD" returned: 1 in 0.480s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Temporary image 11837121-fd99-448b-9c98-001a1947d358 is fetched for user 6c2a975532a4419ab577664f9fe4b41e. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:19:35 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 1073741824" returned: 0 in 0.552s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[300b870a-bee7-4211-980b-0c53f798f0f0]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:35 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 Sep 08 19:19:35 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:35 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD Sep 08 19:19:35 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (7748e83e-939b-4e9e-bf05-88ba5babb656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc9204b-8855-4cf4-b621-6a002838fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:35 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.622s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-182379198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa655c3-26fe-47a0-8a2a-a022de03e00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:31Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Creating volume 7fa655c3-26fe-47a0-8a2a-a022de03e00b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:35 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc9204b-8855-4cf4-b621-6a002838fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1843522784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1362b0b-c963-4d42-af7c-a2636a08a830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:36Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a79427-34c0-485d-a81a-a0de6d5d5fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:35 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b 1073741824 Sep 08 19:19:35 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:35 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a79427-34c0-485d-a81a-a0de6d5d5fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e50c4a-4680-4c4c-8e5c-f64be863d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e50c4a-4680-4c4c-8e5c-f64be863d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1362b0b-c963-4d42-af7c-a2636a08a830', 'volume_name': 'volume-e1362b0b-c963-4d42-af7c-a2636a08a830', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ced9e9e-f63a-466a-af02-684bbfefeb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ced9e9e-f63a-466a-af02-684bbfefeb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9134bd-15f1-4b30-ade3-8b20dfd8b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:35 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Volume e1362b0b-c963-4d42-af7c-a2636a08a830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1362b0b-c963-4d42-af7c-a2636a08a830', 'volume_size': 1} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b45b27-8142-41a9-ba69-d00d852aa17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77bcf37c-8602-486f-a5d0-aa708643bc79', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21b8f77-eff8-4b3c-9a40-c0d73d4af0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume volume-77bcf37c-8602-486f-a5d0-aa708643bc79 (77bcf37c-8602-486f-a5d0-aa708643bc79): created successfully Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21b8f77-eff8-4b3c-9a40-c0d73d4af0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (e8cd628e-94ae-4af4-b003-2df8601721bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0ed8a5cc-be28-429d-9ac6-7e47057194f2 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created volume successfully. Sep 08 19:19:36 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD Sep 08 19:19:36 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-327c9317-4753-42c8-8ce4-5acc9447baad-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-327c9317-4753-42c8-8ce4-5acc9447baad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-quobyte-327c9317-4753-42c8-8ce4-5acc9447baad" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-327c9317-4753-42c8-8ce4-5acc9447baad" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[370bffa6-b942-4ead-8196-9eac12dc9164]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:36 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:36 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad Sep 08 19:19:36 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:36 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b 1073741824" returned: 0 in 0.482s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:36 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b Sep 08 19:19:36 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:36 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad" returned: 0 in 0.397s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:36 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad Sep 08 19:19:36 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:36 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b" returned: 0 in 0.256s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.991s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301466364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929deba2-4941-46d8-bfb5-5264291bbf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:31Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Creating volume 929deba2-4941-46d8-bfb5-5264291bbf0c {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:36 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:36 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c 1073741824 Sep 08 19:19:36 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d691e24c-4585-4d40-b584-d4a667698b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ead1c8a-535f-4717-8693-ed95021980b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b (7fa655c3-26fe-47a0-8a2a-a022de03e00b): created successfully Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ead1c8a-535f-4717-8693-ed95021980b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (d9b85b35-a2be-45f0-91be-fea5de71fa50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a2084f57-a80a-4e96-a28a-a02a9292ca7c tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created volume successfully. Sep 08 19:19:36 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-327c9317-4753-42c8-8ce4-5acc9447baad" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-327c9317-4753-42c8-8ce4-5acc9447baad" released by "delete_volume" :: held 0.706s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:36 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Created reservations ['220602b1-4307-4dc4-9a64-a02ff9f6a024', 'ad737963-a345-4da6-8835-17911c1879f3', '85316ef4-0b2f-449e-95d8-72467341d19d', 'd635a6e9-114d-4011-b06a-ded55e3706f5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:37 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:37 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:37 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c 1073741824" returned: 0 in 0.542s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-5ed2598f-2803-43b6-b6ca-54948437c1a8-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:37 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.286s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-5ed2598f-2803-43b6-b6ca-54948437c1a8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:37 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c Sep 08 19:19:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Deleted volume successfully. Sep 08 19:19:37 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1c44b755-e505-405e-925c-f6d77b721cdc tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-327c9317-4753-42c8-8ce4-5acc9447baad-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-quobyte-5ed2598f-2803-43b6-b6ca-54948437c1a8" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-5ed2598f-2803-43b6-b6ca-54948437c1a8" acquired by "delete_volume" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef5968b-eaad-41dd-a317-160abe8edb0a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:37 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 Sep 08 19:19:37 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:37 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c" returned: 0 in 0.281s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.489s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988333034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e473f59-4681-485e-b4d7-5f5cf98d59cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:32Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Creating volume 0e473f59-4681-485e-b4d7-5f5cf98d59cf {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:37 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9f77eb-1b9b-489b-be88-1a57a8910141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929deba2-4941-46d8-bfb5-5264291bbf0c', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def6a72f-bd3b-4de3-bfdd-7bda89b8b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:37 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf 1073741824 Sep 08 19:19:37 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:37 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume volume-929deba2-4941-46d8-bfb5-5264291bbf0c (929deba2-4941-46d8-bfb5-5264291bbf0c): created successfully Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def6a72f-bd3b-4de3-bfdd-7bda89b8b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (68f38c36-e897-4add-84c8-ea249cfa9093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-bdee2c70-a640-4b33-a26b-243dae52d316 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created volume successfully. Sep 08 19:19:37 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8" returned: 0 in 0.371s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:37 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8 Sep 08 19:19:37 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:38 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-5ed2598f-2803-43b6-b6ca-54948437c1a8" returned: 0 in 0.263s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:38 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf 1073741824" returned: 0 in 0.461s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-5ed2598f-2803-43b6-b6ca-54948437c1a8" released by "delete_volume" :: held 0.682s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:38 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf Sep 08 19:19:38 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Created reservations ['77278bf6-bea0-4a1e-845b-0112f221c939', '723c5513-014f-45db-8934-cd976a257d7c', '29e2097d-3004-4b49-895b-93036d13205f', '31df3fbf-eb2d-4574-9021-381b29aeba26'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:38 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:38 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:38 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf" returned: 0 in 0.271s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.639s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-318838696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de4974c-0d1c-4884-86ae-e765e7e909e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b3732260184638839f7f40f0f25057',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:33Z,use_quota=True,user_id='e9486ef0355540eda8feefb464ff704b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Creating volume 9de4974c-0d1c-4884-86ae-e765e7e909e7 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:38 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f2c12a-f022-4854-b474-75ce8ef57f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4d182c-cc7e-4ba4-b3c4-2707b9a84b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:38 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 1073741824 Sep 08 19:19:38 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:38 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf (0e473f59-4681-485e-b4d7-5f5cf98d59cf): created successfully Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4d182c-cc7e-4ba4-b3c4-2707b9a84b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:38 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (5b7e4b5b-aed9-4c14-a119-b592fc05b0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.265s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Deleted volume successfully. Sep 08 19:19:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3393f453-edcf-4754-9712-5a3fd9a0e5a0 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created volume successfully. Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-ec31c066-ea21-4341-a9cb-c5ee4bd6862f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c2d37093-6922-4699-b52e-0d6fa9e68150 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-5ed2598f-2803-43b6-b6ca-54948437c1a8-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-ec31c066-ea21-4341-a9cb-c5ee4bd6862f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-quobyte-ec31c066-ea21-4341-a9cb-c5ee4bd6862f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-ec31c066-ea21-4341-a9cb-c5ee4bd6862f" acquired by "delete_volume" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd0468-6f7d-4c56-88b9-7d06642ae3f2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:38 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f Sep 08 19:19:38 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:38 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 1073741824" returned: 0 in 0.493s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:38 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 Sep 08 19:19:38 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:39 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f" returned: 0 in 0.387s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:39 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f Sep 08 19:19:39 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:39 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7" returned: 0 in 0.260s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.222s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1843522784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1362b0b-c963-4d42-af7c-a2636a08a830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:36Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Creating volume e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:39 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f385bd-433e-4373-9b90-86c22c477ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de4974c-0d1c-4884-86ae-e765e7e909e7', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:39 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 1073741824 Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fd3c69-b862-421b-9107-7166e3567a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:39 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:39 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-ec31c066-ea21-4341-a9cb-c5ee4bd6862f" returned: 0 in 0.256s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-ec31c066-ea21-4341-a9cb-c5ee4bd6862f" released by "delete_volume" :: held 0.692s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:39 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Volume volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 (9de4974c-0d1c-4884-86ae-e765e7e909e7): created successfully Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56fd3c69-b862-421b-9107-7166e3567a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Flow 'volume_create_manager' (d6c2839a-4950-4c8a-8b7a-02c39126cb52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9cdf1138-64fd-4ba7-ab16-fe7f24d2ea06 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created volume successfully. Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Created reservations ['cc79fe45-afe7-4ba6-8f9a-eb94ea6a7814', '06c49a76-4b67-489f-a69a-14cbb4746d40', '67dc67d4-af12-40d8-8d54-32c917590544', 'a7e88dee-dada-4500-b05f-3e14633dd829'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:39 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:39 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:39 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-03a060d2-3967-436d-9e1b-e6f7fb7fa93f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 1073741824" returned: 0 in 0.466s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-03a060d2-3967-436d-9e1b-e6f7fb7fa93f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:39 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.310s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:39 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Deleted volume successfully. Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-quobyte-03a060d2-3967-436d-9e1b-e6f7fb7fa93f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:39 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 Sep 08 19:19:39 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f023ea2f-faf9-473e-9344-84123e775f4c tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-ec31c066-ea21-4341-a9cb-c5ee4bd6862f-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-03a060d2-3967-436d-9e1b-e6f7fb7fa93f" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c32a56-37e2-42ca-b2b7-4e5bfd9d4d9f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:39 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f Sep 08 19:19:39 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830" returned: 0 in 0.270s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.675s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a837412-5ca8-45a5-b3f6-a9bfdea567fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8cb4c8b73146a6996b4286ac24a9ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:34Z,use_quota=True,user_id='6c2a975532a4419ab577664f9fe4b41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(589a396c-29e3-49d5-8bc5-643036fb0f93),volume_type_id=589a396c-29e3-49d5-8bc5-643036fb0f93)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Creating volume 2a837412-5ca8-45a5-b3f6-a9bfdea567fc {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:40 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9134bd-15f1-4b30-ade3-8b20dfd8b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1362b0b-c963-4d42-af7c-a2636a08a830', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6f4ef6-8400-480d-95be-2d01b900c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:40 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc 1073741824 Sep 08 19:19:40 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Volume volume-e1362b0b-c963-4d42-af7c-a2636a08a830 (e1362b0b-c963-4d42-af7c-a2636a08a830): created successfully Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6f4ef6-8400-480d-95be-2d01b900c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (7748e83e-939b-4e9e-bf05-88ba5babb656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:40 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-05c0cfd6-4341-47fe-8238-1520a20945db tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:19:40 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f" returned: 0 in 0.391s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f Sep 08 19:19:40 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-03a060d2-3967-436d-9e1b-e6f7fb7fa93f" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-9de4974c-0d1c-4884-86ae-e765e7e909e7-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-03a060d2-3967-436d-9e1b-e6f7fb7fa93f" released by "delete_volume" :: held 0.719s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-9de4974c-0d1c-4884-86ae-e765e7e909e7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:40 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc 1073741824" returned: 0 in 0.510s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-quobyte-9de4974c-0d1c-4884-86ae-e765e7e909e7" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-9de4974c-0d1c-4884-86ae-e765e7e909e7" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Created reservations ['c5de8f74-650f-4a24-a2d7-6025ba315c7e', '567177b1-9d74-4bee-8a09-cdeb933f2d58', '47354931-64ee-4fe1-adb9-c44e5d862107', '9e263b76-2e72-4045-a288-0506ff899502'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:40 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc Sep 08 19:19:40 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f1113e-1eb6-4127-8ce9-a47027803261]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:40 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 Sep 08 19:19:40 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-97366387-9af8-47bd-a824-04278d062500-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:40 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc" returned: 0 in 0.306s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-97366387-9af8-47bd-a824-04278d062500-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Attempting download of 11837121-fd99-448b-9c98-001a1947d358 ((None, [{'url': 'file:///opt/stack/data/glance/images/11837121-fd99-448b-9c98-001a1947d358', 'metadata': {}}])) to volume 2a837412-5ca8-45a5-b3f6-a9bfdea567fc. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:19:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "cinder-quobyte-97366387-9af8-47bd-a824-04278d062500" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-97366387-9af8-47bd-a824-04278d062500" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[014af83c-f5ec-4ce9-809f-60964af6bf3d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0baf7c-76a7-49ad-ba3a-ebc88a389299]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11837121-fd99-448b-9c98-001a1947d358_k_wpw9ar {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:41 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.383s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Deleted volume successfully. Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e03150f-b7e0-4029-bd76-477ba3266300 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-03a060d2-3967-436d-9e1b-e6f7fb7fa93f-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:41 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7" returned: 0 in 0.539s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:41 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 Sep 08 19:19:41 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11837121-fd99-448b-9c98-001a1947d358_k_wpw9ar Sep 08 19:19:41 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7 Sep 08 19:19:41 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11837121-fd99-448b-9c98-001a1947d358_k_wpw9ar" returned: 0 in 0.419s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11837121-fd99-448b-9c98-001a1947d358_k_wpw9ar {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:41 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9de4974c-0d1c-4884-86ae-e765e7e909e7" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-9de4974c-0d1c-4884-86ae-e765e7e909e7" released by "delete_volume" :: held 0.927s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:41 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500" returned: 0 in 0.511s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:41 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500 Sep 08 19:19:41 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:41 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11837121-fd99-448b-9c98-001a1947d358_k_wpw9ar Sep 08 19:19:41 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Creating offline snapshot fefb82ad-e451-4b1f-bed3-dac5987930de of volume e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created reservations ['65c6a91d-2a1c-46f0-8da3-c14237d5d050', 'e61608a9-22ed-4377-a7b7-7fc5f0b39d5a', '41b58d66-13a8-4513-943d-30f81ec3d81f', 'dadd8c50-3210-4129-a3f3-0b2741f9f365'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aeba4a-f6cc-4ffd-9da6-cb6d715bd972]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:41 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:41 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 Sep 08 19:19:41 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97366387-9af8-47bd-a824-04278d062500" returned: 0 in 0.346s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11837121-fd99-448b-9c98-001a1947d358_k_wpw9ar" returned: 1 in 0.443s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11837121-fd99-448b-9c98-001a1947d358_k_wpw9ar' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e78f04-8186-437e-8c43-beac483081cb]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-quobyte-97366387-9af8-47bd-a824-04278d062500" released by "delete_volume" :: held 0.941s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Created reservations ['ce9d8a7a-a990-47c6-b25c-6197ac8cec8c', '6661c74c-a5e7-4cec-ac81-2779145c4bfa', '78dd313f-41a5-48a7-94fe-7e958d24f519', 'cd2e45b1-4d54-418a-ba04-3407d3159aaa'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:42 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD Sep 08 19:19:42 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:42 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.380s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:42 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Deleted volume successfully. Sep 08 19:19:42 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830" returned: 0 in 0.527s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6569b79f-c618-4962-9895-3fc35eac1297 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-9de4974c-0d1c-4884-86ae-e765e7e909e7-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:42 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de 1G Sep 08 19:19:42 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:42 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Deleted volume successfully. Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-83326719-5373-4238-b198-c90ad171bc94 tempest-CreateVolumesFromImageTest-1286339078 None] Lock "cinder-97366387-9af8-47bd-a824-04278d062500-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:42 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD Sep 08 19:19:42 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de 1G" returned: 0 in 0.500s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1362b0b-c963-4d42-af7c-a2636a08a830 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-0e473f59-4681-485e-b4d7-5f5cf98d59cf-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:42 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1362b0b-c963-4d42-af7c-a2636a08a830 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de Sep 08 19:19:42 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-0e473f59-4681-485e-b4d7-5f5cf98d59cf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:42 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] 11837121-fd99-448b-9c98-001a1947d358 was raw, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc Sep 08 19:19:42 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-quobyte-0e473f59-4681-485e-b4d7-5f5cf98d59cf" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-0e473f59-4681-485e-b4d7-5f5cf98d59cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[969bcc70-bbde-424d-9520-9153c324c4e9]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf Sep 08 19:19:43 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1362b0b-c963-4d42-af7c-a2636a08a830 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de" returned: 0 in 0.447s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de is being set with open permissions: ugo+rw Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de Sep 08 19:19:43 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf" returned: 0 in 0.484s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf Sep 08 19:19:43 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc" returned: 0 in 0.664s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11837121-fd99-448b-9c98-001a1947d358_k8n2jat9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:19:43 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc 1G Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de" returned: 0 in 0.327s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.info Sep 08 19:19:43 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0e473f59-4681-485e-b4d7-5f5cf98d59cf" returned: 0 in 0.346s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-0e473f59-4681-485e-b4d7-5f5cf98d59cf" released by "delete_volume" :: held 0.896s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created reservations ['121f98f9-ede4-4ff1-89cd-855d3083a1a2', 'a2b96361-7e5b-4630-9545-8d39724ef835', '357732ba-1789-4f80-bd99-e14006171214', '97890434-03dd-435a-bc22-6add5df61173'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:43 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.info" returned: 0 in 0.322s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.info is being set with open permissions: ugo+rw Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc 1G" returned: 0 in 0.434s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Downloaded image 11837121-fd99-448b-9c98-001a1947d358 ((None, [{'url': 'file:///opt/stack/data/glance/images/11837121-fd99-448b-9c98-001a1947d358', 'metadata': {}}])) to volume 2a837412-5ca8-45a5-b3f6-a9bfdea567fc successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Temporary image 11837121-fd99-448b-9c98-001a1947d358 for user 6c2a975532a4419ab577664f9fe4b41e is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Marking volume 2a837412-5ca8-45a5-b3f6-a9bfdea567fc as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:19:43 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.info Sep 08 19:19:43 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Copying metadata from image 11837121-fd99-448b-9c98-001a1947d358 to 2a837412-5ca8-45a5-b3f6-a9bfdea567fc. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Creating volume glance metadata for volume 2a837412-5ca8-45a5-b3f6-a9bfdea567fc backed by image 11837121-fd99-448b-9c98-001a1947d358 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '11837121-fd99-448b-9c98-001a1947d358', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0a6821c2aebee95d82e0191f2a262365', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:44 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:44 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-929deba2-4941-46d8-bfb5-5264291bbf0c-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-929deba2-4941-46d8-bfb5-5264291bbf0c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58063a3c-3f69-4175-a178-83ec7147a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc', 'volume_size': 1, 'image_id': '11837121-fd99-448b-9c98-001a1947d358', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11837121-fd99-448b-9c98-001a1947d358', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a6821c2aebee95d82e0191f2a262365', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e8cb4c8b73146a6996b4286ac24a9ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '53c5c08ab0004fbb031add7a8d6eb08868fda5a486c9b6f533547b3857d69644f72ae1e57235605ffe89555c858e1e34b9c711d5b113e710ca6a5cf2e67ef7d1', 'id': '11837121-fd99-448b-9c98-001a1947d358', 'created_at': datetime.datetime(2026, 9, 8, 17, 19, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 19, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11837121-fd99-448b-9c98-001a1947d358/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378389b6-ea23-405d-a52d-5f9f23abfc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:44 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Volume volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc (2a837412-5ca8-45a5-b3f6-a9bfdea567fc): created successfully Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378389b6-ea23-405d-a52d-5f9f23abfc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Flow 'volume_create_manager' (0b7a571a-41ff-4e0e-b3e5-774d600cbe5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-quobyte-929deba2-4941-46d8-bfb5-5264291bbf0c" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-4ce2b8f4-e4dc-428e-90ea-4dd04eb63fbc tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Created volume successfully. Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-929deba2-4941-46d8-bfb5-5264291bbf0c" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a4a369-a09b-4f54-b639-92e4bdc0b545]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:44 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.345s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:44 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c Sep 08 19:19:44 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Deleted volume successfully. Sep 08 19:19:44 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.info" returned: 0 in 0.459s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f0a2aa98-97d8-4f24-97dd-4923ddf55a89 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-0e473f59-4681-485e-b4d7-5f5cf98d59cf-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-da61438e-c923-4855-9616-acc9568e92d5 tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Acquiring lock "cinder-2a837412-5ca8-45a5-b3f6-a9bfdea567fc-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "cinder-2a837412-5ca8-45a5-b3f6-a9bfdea567fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Acquiring lock "cinder-quobyte-2a837412-5ca8-45a5-b3f6-a9bfdea567fc" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "cinder-quobyte-2a837412-5ca8-45a5-b3f6-a9bfdea567fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c184417f-cec1-42b6-80a4-385fe9b19662]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:44 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c" returned: 0 in 0.446s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:44 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c Sep 08 19:19:44 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:44 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc Sep 08 19:19:44 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-fefb82ad-e451-4b1f-bed3-dac5987930de-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Lock "cinder-fefb82ad-e451-4b1f-bed3-dac5987930de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-e1362b0b-c963-4d42-af7c-a2636a08a830" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-e1362b0b-c963-4d42-af7c-a2636a08a830" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-fefb82ad-e451-4b1f-bed3-dac5987930de" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-fefb82ad-e451-4b1f-bed3-dac5987930de" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot fefb82ad-e451-4b1f-bed3-dac5987930de of volume e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96329eb-f892-4f6a-bbf3-9d8c1a5819cf]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc" returned: 0 in 0.453s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-929deba2-4941-46d8-bfb5-5264291bbf0c" returned: 0 in 0.381s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de Sep 08 19:19:45 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-929deba2-4941-46d8-bfb5-5264291bbf0c" released by "delete_volume" :: held 0.878s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:45 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc Sep 08 19:19:45 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created reservations ['4011357c-64ea-4929-839f-fcc818c95113', 'd2cb3e0e-dea6-47e9-8d3f-5dd29afcad55', '5103c519-b44c-4344-a208-fa1861a13484', 'b9e895fe-152d-4197-bf73-02a0540d9e5f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-7fa655c3-26fe-47a0-8a2a-a022de03e00b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:45 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:45 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-7fa655c3-26fe-47a0-8a2a-a022de03e00b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:45 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a837412-5ca8-45a5-b3f6-a9bfdea567fc" returned: 0 in 0.415s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de" returned: 0 in 0.549s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1362b0b-c963-4d42-af7c-a2636a08a830(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-quobyte-7fa655c3-26fe-47a0-8a2a-a022de03e00b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "cinder-quobyte-2a837412-5ca8-45a5-b3f6-a9bfdea567fc" released by "delete_volume" :: held 0.934s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98d3a34-6901-43aa-8da7-d14573dfaa8f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-7fa655c3-26fe-47a0-8a2a-a022de03e00b" acquired by "delete_volume" :: waited 0.043s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f0e53-0869-4091-8ed9-4866876244be]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 Sep 08 19:19:45 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Created reservations ['df755066-04a5-452f-97cf-78ad51493c58', 'ea1e3d6d-28fb-494e-9987-064c496389fa', '5ed63d27-233b-46dc-8278-f142f3bb09c6', 'cd1f469b-84e2-443d-be42-06b816518a1f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:45 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.410s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Deleted volume successfully. Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-175ee06f-4f38-4c8d-9a56-c525d932babf tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-929deba2-4941-46d8-bfb5-5264291bbf0c-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:45 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b Sep 08 19:19:45 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:45 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830" returned: 0 in 0.475s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:46 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de Sep 08 19:19:46 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:46 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:46 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b" returned: 0 in 0.585s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.367s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Deleted volume successfully. Sep 08 19:19:46 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b Sep 08 19:19:46 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Flow 'volume_create_manager' (70856f58-b9ab-4361-bc01-6ecaee1dd9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a52cb45-7672-4fb1-8bb4-6e032ba64bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a52cb45-7672-4fb1-8bb4-6e032ba64bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-39133708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eca3a8-b773-429b-8778-bb0e7a3d6577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afaac3e9267949ef9597928b9e3c2816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:46Z,use_quota=True,user_id='8936e624888642d68d6270e1e7a03118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8daa8f-0f0a-49cd-86ec-440ab6c4e615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8daa8f-0f0a-49cd-86ec-440ab6c4e615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963fe1bd-0919-4cc5-8a3e-1d8dd7bcdd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963fe1bd-0919-4cc5-8a3e-1d8dd7bcdd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37eca3a8-b773-429b-8778-bb0e7a3d6577', 'volume_name': 'volume-37eca3a8-b773-429b-8778-bb0e7a3d6577', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c780ec3-fa90-4a81-9fc1-30ba55be923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c780ec3-fa90-4a81-9fc1-30ba55be923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7d4e81-3bcf-44de-ae21-89af0cb6a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:46 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Volume 37eca3a8-b773-429b-8778-bb0e7a3d6577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37eca3a8-b773-429b-8778-bb0e7a3d6577', 'volume_size': 1} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-39133708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eca3a8-b773-429b-8778-bb0e7a3d6577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afaac3e9267949ef9597928b9e3c2816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:46Z,use_quota=True,user_id='8936e624888642d68d6270e1e7a03118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Creating volume 37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:46 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-51aa9bfd-4d72-4f8d-bf89-49ac6022b843 tempest-VolumeAndVolumeTypeFromImageTest-1852370893 None] Lock "cinder-2a837412-5ca8-45a5-b3f6-a9bfdea567fc-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:46 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 1073741824 Sep 08 19:19:46 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:46 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de" returned: 0 in 0.435s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:46 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-7fa655c3-26fe-47a0-8a2a-a022de03e00b" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:46 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de Sep 08 19:19:46 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-7fa655c3-26fe-47a0-8a2a-a022de03e00b" released by "delete_volume" :: held 0.932s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created reservations ['0efdc61f-0520-4798-b450-462a01852b6c', 'afa61a78-39c9-4643-a7c8-b3a63f725ef5', '9082a2ae-a640-4c8f-95af-bc002060feae', '89af8b50-5866-4ee8-a9c4-8c18485fffac'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:46 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:46 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:46 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830.fefb82ad-e451-4b1f-bed3-dac5987930de" returned: 0 in 0.290s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-fefb82ad-e451-4b1f-bed3-dac5987930de" released by "_delete_snapshot" :: held 1.886s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-e1362b0b-c963-4d42-af7c-a2636a08a830" released by "delete_snapshot" :: held 1.923s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:46 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 1073741824" returned: 0 in 0.543s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Created reservations ['da802f94-31d0-4838-8e61-ea9bcf2d2770', '1a8d6e5c-3b79-42ac-bb3d-1db304dacecd', '5b788fd9-a58d-48a9-b680-9b8586f74af3', 'c0dd6db1-b318-463c-963c-406e266ad468'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:46 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.325s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Deleted volume successfully. Sep 08 19:19:46 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 Sep 08 19:19:46 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:19:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d797cd86-55cd-488f-8f01-2d871ba3f663 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-7fa655c3-26fe-47a0-8a2a-a022de03e00b-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2c8a932d-41df-442d-92e6-65606c80878e tempest-ProjectMemberTests-823681440 None] Lock "cinder-fefb82ad-e451-4b1f-bed3-dac5987930de-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-e1362b0b-c963-4d42-af7c-a2636a08a830-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Lock "cinder-e1362b0b-c963-4d42-af7c-a2636a08a830-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-e1362b0b-c963-4d42-af7c-a2636a08a830" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:47 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577" returned: 0 in 0.303s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-e1362b0b-c963-4d42-af7c-a2636a08a830" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7d4e81-3bcf-44de-ae21-89af0cb6a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37eca3a8-b773-429b-8778-bb0e7a3d6577', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f84446-c87f-40d4-9d5a-4ecfea09da92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[faade3f0-75e9-46d5-9280-e29ffa28da51]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:47 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Volume volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 (37eca3a8-b773-429b-8778-bb0e7a3d6577): created successfully Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f84446-c87f-40d4-9d5a-4ecfea09da92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Flow 'volume_create_manager' (70856f58-b9ab-4361-bc01-6ecaee1dd9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:47 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0380f9ed-2492-4bf9-bd27-4b404b3a2e51 tempest-VolumeDependencyTests-1927967957 None] Created volume successfully. Sep 08 19:19:47 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 Sep 08 19:19:47 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-77bcf37c-8602-486f-a5d0-aa708643bc79-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-77bcf37c-8602-486f-a5d0-aa708643bc79-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:47 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830" returned: 0 in 0.438s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-quobyte-77bcf37c-8602-486f-a5d0-aa708643bc79" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:47 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830 Sep 08 19:19:47 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-77bcf37c-8602-486f-a5d0-aa708643bc79" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d114b49-f2ac-487c-bf47-aee464d6294a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:47 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 Sep 08 19:19:47 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:47 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e1362b0b-c963-4d42-af7c-a2636a08a830" returned: 0 in 0.269s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-e1362b0b-c963-4d42-af7c-a2636a08a830" released by "delete_volume" :: held 0.778s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Created reservations ['79e02aa8-871e-4fd4-ba2e-115e943e08e9', '89cfb672-950a-4efe-8659-079523f07acb', '6e6b1bf1-1db2-4593-82d7-da00822d55c4', 'fc3b2306-f33a-4903-af0b-f33eea91f9f8'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:48 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:48 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79" returned: 0 in 0.493s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:48 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:48 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79 Sep 08 19:19:48 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:48 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.362s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Creating offline snapshot 4f07d61f-f944-4f87-9251-d31456714c6c of volume 37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d5e30da0-2aeb-4bf3-ad8f-4c2fef29739e tempest-ProjectMemberTests-823681440 None] Lock "cinder-e1362b0b-c963-4d42-af7c-a2636a08a830-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c62bf-b1a3-42dd-b09e-99d71ff1b74e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:48 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-77bcf37c-8602-486f-a5d0-aa708643bc79" returned: 0 in 0.414s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-77bcf37c-8602-486f-a5d0-aa708643bc79" released by "delete_volume" :: held 0.968s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created reservations ['a3a73300-ef6f-4a3b-b018-81ff8f7b6766', 'ba276dfd-dc7b-4d49-94c3-d7f67ae31b49', '5dfde4e6-66d0-4c3b-aa1b-cabef16e9fce', '6abaa5d0-b173-4442-a375-593fc8d5e2fa'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:48 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 Sep 08 19:19:48 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:49 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:49 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (c7bb3b0f-b719-4f4b-b26e-12bdb9322bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afedde-a70e-4901-a1e4-d57fa4b86db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28afedde-a70e-4901-a1e4-d57fa4b86db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517109014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaed78a-3d32-4acf-9798-3daec5769590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:49Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae65f922-c6c7-45da-84aa-2c4d88e37af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:49 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae65f922-c6c7-45da-84aa-2c4d88e37af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b757c3-5190-4e33-85e3-0428119b6438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b757c3-5190-4e33-85e3-0428119b6438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beaed78a-3d32-4acf-9798-3daec5769590', 'volume_name': 'volume-beaed78a-3d32-4acf-9798-3daec5769590', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940cb0be-c6ed-4a9c-a358-10adc2526b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940cb0be-c6ed-4a9c-a358-10adc2526b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90169f50-f9e9-4779-921d-dd0a1e840ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Volume beaed78a-3d32-4acf-9798-3daec5769590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beaed78a-3d32-4acf-9798-3daec5769590', 'volume_size': 1} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577" returned: 0 in 0.579s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:49 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c 1G Sep 08 19:19:49 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:49 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.329s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Deleted volume successfully. Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1ec4a180-b2d1-4611-b3b6-9d2a1ac32c51 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-77bcf37c-8602-486f-a5d0-aa708643bc79-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:49 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c 1G" returned: 0 in 0.470s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:49 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c Sep 08 19:19:49 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:49 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-abfc043d-fda0-478c-bf90-cd28c752d84b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-abfc043d-fda0-478c-bf90-cd28c752d84b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "cinder-quobyte-abfc043d-fda0-478c-bf90-cd28c752d84b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-abfc043d-fda0-478c-bf90-cd28c752d84b" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:50 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c" returned: 0 in 0.389s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:50 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c is being set with open permissions: ugo+rw Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f6d1a8-bf41-4560-88f1-bb32ff7b79ee]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:50 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c Sep 08 19:19:50 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:50 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b Sep 08 19:19:50 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:50 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:50 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.info Sep 08 19:19:50 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:50 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b" returned: 0 in 0.422s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:50 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b Sep 08 19:19:50 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:50 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.info" returned: 0 in 0.284s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:50 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.info is being set with open permissions: ugo+rw Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:50 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.info Sep 08 19:19:50 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:50 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-abfc043d-fda0-478c-bf90-cd28c752d84b" returned: 0 in 0.268s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-quobyte-abfc043d-fda0-478c-bf90-cd28c752d84b" released by "delete_volume" :: held 0.760s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Created reservations ['30a8d2a4-fc2b-4be2-af1f-93817d47e841', '9fcfbfcd-7cce-4758-a380-a6450bcf8d7b', '2aa31c96-31e6-4a68-a81e-d323c652e008', '4fe6f6bb-e85f-476c-9bf3-8e87ae1bd9ad'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:51 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:19:51 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:51 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.info" returned: 0 in 0.287s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517109014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beaed78a-3d32-4acf-9798-3daec5769590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:49Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Creating volume beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:51 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:51 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 1073741824 Sep 08 19:19:51 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0088a38c-34a0-46fb-ad20-5b0f6ddfbea3 tempest-VolumeDependencyTests-1927967957 None] Create snapshot completed successfully Sep 08 19:19:51 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.339s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:51 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Deleted volume successfully. Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-c559c536-fcde-40ea-be97-3a685a0ebdd6 tempest-CreateVolumesFromSourceVolumeTest-798534838 None] Lock "cinder-abfc043d-fda0-478c-bf90-cd28c752d84b-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:51 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 1073741824" returned: 0 in 0.625s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:51 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 Sep 08 19:19:51 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:52 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90169f50-f9e9-4779-921d-dd0a1e840ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beaed78a-3d32-4acf-9798-3daec5769590', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bce5698-995b-41e5-9e2b-95cf49538afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Volume volume-beaed78a-3d32-4acf-9798-3daec5769590 (beaed78a-3d32-4acf-9798-3daec5769590): created successfully Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bce5698-995b-41e5-9e2b-95cf49538afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (c7bb3b0f-b719-4f4b-b26e-12bdb9322bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-62496c71-437e-4bba-a6f4-65296d319615 tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (ba5202ac-57b9-4288-a075-94495d28b7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4212360a-93f9-408f-b9d4-0f16ad4c2975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4212360a-93f9-408f-b9d4-0f16ad4c2975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74908819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3094b7c3-c520-45be-b1e8-b57c102db32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:52Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c74ade-1dbf-4dd2-a466-025e696d0f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c74ade-1dbf-4dd2-a466-025e696d0f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3064b29b-adb0-42df-9df9-bd1ebca9abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3064b29b-adb0-42df-9df9-bd1ebca9abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3094b7c3-c520-45be-b1e8-b57c102db32b', 'volume_name': 'volume-3094b7c3-c520-45be-b1e8-b57c102db32b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ddf4f8-c9dd-4ab5-952a-2e9e02feb659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ddf4f8-c9dd-4ab5-952a-2e9e02feb659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e525e11-455d-4b3b-b7c2-1a22192b8b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume 3094b7c3-c520-45be-b1e8-b57c102db32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3094b7c3-c520-45be-b1e8-b57c102db32b', 'volume_size': 1} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74908819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3094b7c3-c520-45be-b1e8-b57c102db32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:52Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Creating volume 3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:52 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:52 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b 1073741824 Sep 08 19:19:52 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Flow 'volume_create_manager' (6088dcb6-0bb4-4171-8d8d-caa044577a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a102224-e3d0-4235-8879-60f9f05a1e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a102224-e3d0-4235-8879-60f9f05a1e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-163779098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e82e7ecd-5e4f-4140-94df-4d07edd9e909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afaac3e9267949ef9597928b9e3c2816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f07d61f-f944-4f87-9251-d31456714c6c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:53Z,use_quota=True,user_id='8936e624888642d68d6270e1e7a03118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4fffc-1078-4386-a6d2-bd6b3afd11af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e4fffc-1078-4386-a6d2-bd6b3afd11af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8383e9-cdda-45d4-9c4d-4ab22d763f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8383e9-cdda-45d4-9c4d-4ab22d763f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e82e7ecd-5e4f-4140-94df-4d07edd9e909', 'volume_name': 'volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909', 'volume_size': 1, 'snapshot_id': '4f07d61f-f944-4f87-9251-d31456714c6c'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b473c204-78cd-43af-905f-fb96b54f6ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b473c204-78cd-43af-905f-fb96b54f6ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285db1f6-7dba-4e79-9697-33ac9bd3f12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Volume e82e7ecd-5e4f-4140-94df-4d07edd9e909: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909', 'volume_size': 1, 'snapshot_id': '4f07d61f-f944-4f87-9251-d31456714c6c'} Sep 08 19:19:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:53 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b 1073741824" returned: 0 in 0.505s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:53 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b Sep 08 19:19:53 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:53 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b" returned: 0 in 0.285s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.767s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e525e11-455d-4b3b-b7c2-1a22192b8b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3094b7c3-c520-45be-b1e8-b57c102db32b', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7692a6-2961-4756-8cd6-c5585f1916dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Creating offline snapshot 292ff6c5-377b-43b9-bdbc-0a6f9feefc3d of volume beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume volume-3094b7c3-c520-45be-b1e8-b57c102db32b (3094b7c3-c520-45be-b1e8-b57c102db32b): created successfully Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7692a6-2961-4756-8cd6-c5585f1916dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (ba5202ac-57b9-4288-a075-94495d28b7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[25091557-364a-4fd9-9a17-616c73bbc617]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2855d063-b198-4402-9a02-27297ae5d795 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created volume successfully. Sep 08 19:19:53 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 Sep 08 19:19:53 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:54 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590" returned: 0 in 0.379s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:54 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d 1G Sep 08 19:19:54 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:54 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Flow 'volume_create_manager' (d9b842fa-a95c-4045-8870-c05752becb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c029b5c-a41a-4139-926b-7d865bd8d646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d 1G" returned: 0 in 0.491s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaed78a-3d32-4acf-9798-3daec5769590 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:54 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaed78a-3d32-4acf-9798-3daec5769590 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d Sep 08 19:19:54 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c029b5c-a41a-4139-926b-7d865bd8d646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ef6483-b0e4-4958-948a-466575c2d797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7419dd1dc91f4dd297ad08b6b9f2c7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:54Z,use_quota=True,user_id='1783e3daf12045f8bdb651d77f75f126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52e3a93-2f7d-47a1-b935-53928cec22bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52e3a93-2f7d-47a1-b935-53928cec22bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7482917e-504b-4b8b-9ae7-058ceb81ee64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7482917e-504b-4b8b-9ae7-058ceb81ee64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ef6483-b0e4-4958-948a-466575c2d797', 'volume_name': 'volume-d1ef6483-b0e4-4958-948a-466575c2d797', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e75189-15a2-4973-89e7-7c70ec2bafbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e75189-15a2-4973-89e7-7c70ec2bafbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4673442-051c-41ac-82b4-22b4c85014e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:54 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Volume d1ef6483-b0e4-4958-948a-466575c2d797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ef6483-b0e4-4958-948a-466575c2d797', 'volume_size': 1} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:54 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beaed78a-3d32-4acf-9798-3daec5769590 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:54 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d is being set with open permissions: ugo+rw Sep 08 19:19:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:54 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d Sep 08 19:19:54 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:55 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" returned: 0 in 0.246s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:55 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.info Sep 08 19:19:55 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:55 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.info" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:55 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.info is being set with open permissions: ugo+rw Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:55 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.info Sep 08 19:19:55 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:55 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.info" returned: 0 in 0.251s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.705s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-quobyte-4f07d61f-f944-4f87-9251-d31456714c6c-e82e7ecd-5e4f-4140-94df-4d07edd9e909" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-4f07d61f-f944-4f87-9251-d31456714c6c-e82e7ecd-5e4f-4140-94df-4d07edd9e909" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Creating volume e82e7ecd-5e4f-4140-94df-4d07edd9e909 from snapshot 4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-quobyte-e82e7ecd-5e4f-4140-94df-4d07edd9e909" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6464c2bf-5f58-4df0-a368-5dc55c4300c8 tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-e82e7ecd-5e4f-4140-94df-4d07edd9e909" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] snapshot: 4f07d61f-f944-4f87-9251-d31456714c6c, volume: e82e7ecd-5e4f-4140-94df-4d07edd9e909, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cf6382-e3aa-4b48-8561-b3e0a1fa880d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-292ff6c5-377b-43b9-bdbc-0a6f9feefc3d-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Lock "cinder-292ff6c5-377b-43b9-bdbc-0a6f9feefc3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-beaed78a-3d32-4acf-9798-3daec5769590" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-beaed78a-3d32-4acf-9798-3daec5769590" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot 292ff6c5-377b-43b9-bdbc-0a6f9feefc3d of volume beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:19:55 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c Sep 08 19:19:55 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b02766e-03ba-4ac1-9ef9-a1e509b9b1fe]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:56 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d Sep 08 19:19:56 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:56 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c" returned: 0 in 0.400s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37eca3a8-b773-429b-8778-bb0e7a3d6577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[502539bf-036c-4894-8190-4e3bef785cf5]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:56 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" returned: 0 in 0.379s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beaed78a-3d32-4acf-9798-3daec5769590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:56 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 Sep 08 19:19:56 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0254cec-8042-4fef-b32d-6c2a486c02a6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:56 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 Sep 08 19:19:56 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:56 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577" returned: 0 in 0.380s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:56 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 Sep 08 19:19:56 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:56 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590" returned: 0 in 0.395s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:56 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d Sep 08 19:19:56 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:57 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" returned: 0 in 0.476s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:57 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d Sep 08 19:19:57 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:57 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590.292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" returned: 0 in 0.497s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-292ff6c5-377b-43b9-bdbc-0a6f9feefc3d" released by "_delete_snapshot" :: held 1.979s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-beaed78a-3d32-4acf-9798-3daec5769590" released by "delete_snapshot" :: held 2.014s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:58 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Created reservations ['6acdc563-f656-4578-8372-410de1d9ec84', '9dd95578-133a-4556-9af3-9153af1059b0', '4ead3b39-df03-407e-82a3-6055d76ab847', '64d908fb-b8b1-4faf-965b-005d7452f4b4'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:19:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a20efda1-4ca5-4429-9f11-9dfca385ac21 tempest-ProjectMemberTests-823681440 None] Lock "cinder-292ff6c5-377b-43b9-bdbc-0a6f9feefc3d-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-beaed78a-3d32-4acf-9798-3daec5769590-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Lock "cinder-beaed78a-3d32-4acf-9798-3daec5769590-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-beaed78a-3d32-4acf-9798-3daec5769590" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:59 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-beaed78a-3d32-4acf-9798-3daec5769590" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8948d5-3772-4ce5-984d-ea0396f6b444]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:59 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 Sep 08 19:19:59 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:00 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590" returned: 0 in 1.042s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:00 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590 Sep 08 19:20:00 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:01 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-beaed78a-3d32-4acf-9798-3daec5769590" returned: 0 in 0.491s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-beaed78a-3d32-4acf-9798-3daec5769590" released by "delete_volume" :: held 1.661s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Created reservations ['9603f30c-0825-4a3b-8488-047ef67013dd', 'ec36f192-0763-46de-b787-c90b40e5f8ec', 'd80c73f9-3842-4fba-a9dc-82e4eba79138', 'f4869d41-177b-4c52-9ad1-66f35f6a8692'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:01 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:01 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:01 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909" returned: 0 in 4.821s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:20:01 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Converted 1024.00 MB image at 212.33 MB/s Sep 08 19:20:01 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 is being set with open permissions: ugo+rw Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:01 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 Sep 08 19:20:01 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:01 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.294s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:01 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:20:01 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909" returned: 0 in 0.283s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-e82e7ecd-5e4f-4140-94df-4d07edd9e909" released by "_copy_volume_from_snapshot" :: held 5.968s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6145f0d0-d1c4-49f1-989b-1bcb7be9120f tempest-ProjectMemberTests-823681440 None] Lock "cinder-beaed78a-3d32-4acf-9798-3daec5769590-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-4f07d61f-f944-4f87-9251-d31456714c6c-e82e7ecd-5e4f-4140-94df-4d07edd9e909" released by "_create_volume_from_snapshot" :: held 6.035s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.056s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.096s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ef6483-b0e4-4958-948a-466575c2d797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7419dd1dc91f4dd297ad08b6b9f2c7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:54Z,use_quota=True,user_id='1783e3daf12045f8bdb651d77f75f126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Creating volume d1ef6483-b0e4-4958-948a-466575c2d797 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:01 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:01 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 1073741824 Sep 08 19:20:01 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285db1f6-7dba-4e79-9697-33ac9bd3f12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909', 'volume_size': 1, 'snapshot_id': '4f07d61f-f944-4f87-9251-d31456714c6c'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d244856b-ec07-4bce-b328-2497332bbe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:01 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Volume volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 (e82e7ecd-5e4f-4140-94df-4d07edd9e909): created successfully Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d244856b-ec07-4bce-b328-2497332bbe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:01 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Flow 'volume_create_manager' (6088dcb6-0bb4-4171-8d8d-caa044577a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:01 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-89bc9bc0-1ae6-400a-bbd8-87c8cc33bdd0 tempest-VolumeDependencyTests-1927967957 None] Created volume successfully. Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (eed78de9-c2c6-4f1e-86d6-5dadf32ab231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8fb90a-384f-4cef-bc62-2d3c16d94467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8fb90a-384f-4cef-bc62-2d3c16d94467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772122085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c251c2ca-61c5-47a2-83f5-7214144b686f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:02Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f75fc27-0fa7-4e80-8fb3-2f5520907c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f75fc27-0fa7-4e80-8fb3-2f5520907c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319fba64-af27-4fbb-91ff-5dcaddd89e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319fba64-af27-4fbb-91ff-5dcaddd89e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c251c2ca-61c5-47a2-83f5-7214144b686f', 'volume_name': 'volume-c251c2ca-61c5-47a2-83f5-7214144b686f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90ede24-8be0-4b43-8b9c-69865736bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90ede24-8be0-4b43-8b9c-69865736bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eba12cf-0eda-4e7c-a2a0-db29dfab500e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Volume c251c2ca-61c5-47a2-83f5-7214144b686f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c251c2ca-61c5-47a2-83f5-7214144b686f', 'volume_size': 1} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:02 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 1073741824" returned: 0 in 0.521s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:02 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 Sep 08 19:20:02 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-4f07d61f-f944-4f87-9251-d31456714c6c-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-4f07d61f-f944-4f87-9251-d31456714c6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-quobyte-37eca3a8-b773-429b-8778-bb0e7a3d6577" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-37eca3a8-b773-429b-8778-bb0e7a3d6577" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-quobyte-4f07d61f-f944-4f87-9251-d31456714c6c" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-4f07d61f-f944-4f87-9251-d31456714c6c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Deleting offline snapshot 4f07d61f-f944-4f87-9251-d31456714c6c of volume 37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] snapshot_file for this snap is: volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[503f4d18-7e21-46fd-aea7-310ebb8d4717]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:02 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797" returned: 0 in 0.263s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.757s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4673442-051c-41ac-82b4-22b4c85014e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ef6483-b0e4-4958-948a-466575c2d797', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c Sep 08 19:20:02 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5dd951-e8ff-46a7-9aab-0e9b81a1abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Creating offline snapshot 27b2f787-71eb-4089-b772-b9cb383cef0f of volume 3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:02 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Volume volume-d1ef6483-b0e4-4958-948a-466575c2d797 (d1ef6483-b0e4-4958-948a-466575c2d797): created successfully Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5dd951-e8ff-46a7-9aab-0e9b81a1abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Flow 'volume_create_manager' (d9b842fa-a95c-4045-8870-c05752becb21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec13e6b8-89f9-4169-ad9a-6d9a9eba54e8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1f90f48d-108d-4921-a22b-7cd319e1df1f tempest-CinderUnicodeTest-1428321800 None] Created volume successfully. Sep 08 19:20:02 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b Sep 08 19:20:02 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:02 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c" returned: 0 in 0.373s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37eca3a8-b773-429b-8778-bb0e7a3d6577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f23c9-5cf4-4ab4-b74a-e7eeda797893]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:02 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 Sep 08 19:20:02 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:03 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b" returned: 0 in 0.402s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:03 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f 1G Sep 08 19:20:03 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:03 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577" returned: 0 in 0.589s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:03 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c Sep 08 19:20:03 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:03 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f 1G" returned: 0 in 0.498s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3094b7c3-c520-45be-b1e8-b57c102db32b -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:03 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3094b7c3-c520-45be-b1e8-b57c102db32b -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f Sep 08 19:20:03 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:03 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3094b7c3-c520-45be-b1e8-b57c102db32b -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f" returned: 0 in 0.307s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:03 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f is being set with open permissions: ugo+rw Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:03 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f Sep 08 19:20:03 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:03 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:03 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c Sep 08 19:20:03 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Flow 'volume_create_manager' (53069058-4fc5-4e2b-97ab-6121f70db8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e133167-3fb4-499f-90e7-ef428ed959dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e133167-3fb4-499f-90e7-ef428ed959dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1450334186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7419dd1dc91f4dd297ad08b6b9f2c7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:04Z,use_quota=True,user_id='1783e3daf12045f8bdb651d77f75f126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d803c4e1-c9f5-481c-8793-c0ef940b9929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d803c4e1-c9f5-481c-8793-c0ef940b9929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d072ac2f-ec54-466f-abcc-461707bc96fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d072ac2f-ec54-466f-abcc-461707bc96fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a', 'volume_name': 'volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd3e536-7d77-4ed9-87b4-eda9edf5d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd3e536-7d77-4ed9-87b4-eda9edf5d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a44bee9-7c9a-487d-b6c2-d7eb85e0cf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Volume fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a', 'volume_size': 1} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:04 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577.4f07d61f-f944-4f87-9251-d31456714c6c" returned: 0 in 0.278s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.info Sep 08 19:20:04 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-4f07d61f-f944-4f87-9251-d31456714c6c" released by "_delete_snapshot" :: held 1.757s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-37eca3a8-b773-429b-8778-bb0e7a3d6577" released by "delete_snapshot" :: held 1.777s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Created reservations ['4c1c356a-6eca-4e4c-a8b0-137673fa222c', '7f48cc26-dc7f-4cc6-abfd-e468ba86ff2e', 'e820c59d-ee51-439e-952d-b840bcf84736', 'b769da82-247f-4303-88a3-c9e2d39bd9a5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Delete snapshot completed successfully. Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3220762d-bba3-421e-9bff-445e1f942611 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-4f07d61f-f944-4f87-9251-d31456714c6c-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:04 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.info" returned: 0 in 0.245s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.info is being set with open permissions: ugo+rw Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.info Sep 08 19:20:04 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-37eca3a8-b773-429b-8778-bb0e7a3d6577-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-37eca3a8-b773-429b-8778-bb0e7a3d6577-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:04 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.info" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.398s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1772122085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c251c2ca-61c5-47a2-83f5-7214144b686f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:02Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Creating volume c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:04 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f 1073741824 Sep 08 19:20:04 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-87b8cafa-1495-44fc-887f-cafe1adb168e tempest-CreateVolumesFromSnapshotTest-460795674 None] Create snapshot completed successfully Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-quobyte-37eca3a8-b773-429b-8778-bb0e7a3d6577" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-37eca3a8-b773-429b-8778-bb0e7a3d6577" acquired by "delete_volume" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[88508f65-bdac-4b48-90c5-2abfc20d394e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 Sep 08 19:20:04 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:05 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f 1073741824" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:05 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f Sep 08 19:20:05 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:05 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:05 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577 Sep 08 19:20:05 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:05 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f" returned: 0 in 0.242s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1450334186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7419dd1dc91f4dd297ad08b6b9f2c7df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:04Z,use_quota=True,user_id='1783e3daf12045f8bdb651d77f75f126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Creating volume fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:05 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:05 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a 1073741824 Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eba12cf-0eda-4e7c-a2a0-db29dfab500e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c251c2ca-61c5-47a2-83f5-7214144b686f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:05 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336970f-bb94-42bf-bb2c-c66a70f8f15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:05 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:05 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Volume volume-c251c2ca-61c5-47a2-83f5-7214144b686f (c251c2ca-61c5-47a2-83f5-7214144b686f): created successfully Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336970f-bb94-42bf-bb2c-c66a70f8f15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (eed78de9-c2c6-4f1e-86d6-5dadf32ab231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-37eca3a8-b773-429b-8778-bb0e7a3d6577" returned: 0 in 0.288s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-37eca3a8-b773-429b-8778-bb0e7a3d6577" released by "delete_volume" :: held 0.753s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3e5ba638-f148-4084-9ee1-6106481fe0c2 tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Created reservations ['71ea25ef-9825-41ad-b748-b90ced9087e6', 'b72a1da3-8854-4ac9-8861-6a0c4e58ef3e', '67ba6de3-93e7-401b-a536-ac4ea31afc09', '77db96ec-6f3f-4af8-80f0-ffd98f88f9a5'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:05 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:05 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-e82e7ecd-5e4f-4140-94df-4d07edd9e909-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-e82e7ecd-5e4f-4140-94df-4d07edd9e909-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "cinder-quobyte-e82e7ecd-5e4f-4140-94df-4d07edd9e909" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-e82e7ecd-5e4f-4140-94df-4d07edd9e909" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[705fef58-e139-4081-8da5-553c3653f942]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:05 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.319s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:05 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Deleted volume successfully. Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-74e7d3eb-7bc0-4c3b-85e3-81e35f29043b tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-37eca3a8-b773-429b-8778-bb0e7a3d6577-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:06 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a 1073741824" returned: 0 in 0.662s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:06 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 Sep 08 19:20:06 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:06 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a Sep 08 19:20:06 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (4e441566-5c34-44ab-bc98-f1485ee8053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92772ec0-e79c-4f37-bdd1-eaf211d55deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92772ec0-e79c-4f37-bdd1-eaf211d55deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585500488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8f6b64-4e47-45ec-9ff0-c0c899072e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:06Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8c7c63-9b80-4231-be49-fc205a8a6647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8c7c63-9b80-4231-be49-fc205a8a6647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb70c93-c33d-4d78-80b8-b24e253b2a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb70c93-c33d-4d78-80b8-b24e253b2a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8f6b64-4e47-45ec-9ff0-c0c899072e3a', 'volume_name': 'volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1760ab4-63e2-47e2-887c-150f3cca3ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1760ab4-63e2-47e2-887c-150f3cca3ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcab6e91-7a84-4c79-8286-77ea84cfdd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume fd8f6b64-4e47-45ec-9ff0-c0c899072e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a', 'volume_size': 1} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:06 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909" returned: 0 in 0.476s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:06 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585500488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8f6b64-4e47-45ec-9ff0-c0c899072e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:06Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Creating volume fd8f6b64-4e47-45ec-9ff0-c0c899072e3a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:06 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909 Sep 08 19:20:06 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:06 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a44bee9-7c9a-487d-b6c2-d7eb85e0cf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a 1073741824 Sep 08 19:20:06 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0732fb7a-6557-4b1b-aaab-55fc8f9d74f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Volume volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a (fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a): created successfully Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0732fb7a-6557-4b1b-aaab-55fc8f9d74f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Flow 'volume_create_manager' (53069058-4fc5-4e2b-97ab-6121f70db8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:06 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ed574728-892e-483d-ada4-c7cd3b9e360b tempest-CinderUnicodeTest-1428321800 None] Created volume successfully. Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (8569e9dd-2f76-433b-86c8-b94e0125669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dffcf0e-b384-4e61-8bb0-d579f8cc2540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dffcf0e-b384-4e61-8bb0-d579f8cc2540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794053264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a780194d-d7ad-4fa8-9939-f2b3c838033e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:07Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ef7d43-73f5-4ffd-a362-72ef0c184433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ef7d43-73f5-4ffd-a362-72ef0c184433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77af629c-281e-438f-b474-74b18fc58ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77af629c-281e-438f-b474-74b18fc58ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a780194d-d7ad-4fa8-9939-f2b3c838033e', 'volume_name': 'volume-a780194d-d7ad-4fa8-9939-f2b3c838033e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424997ac-0a54-4b89-b540-5f27a4522806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424997ac-0a54-4b89-b540-5f27a4522806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cab747-164e-4cbf-84df-4fb1ec03ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:06 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume a780194d-d7ad-4fa8-9939-f2b3c838033e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a780194d-d7ad-4fa8-9939-f2b3c838033e', 'volume_size': 1} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:06 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-e82e7ecd-5e4f-4140-94df-4d07edd9e909" returned: 0 in 0.347s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-quobyte-e82e7ecd-5e4f-4140-94df-4d07edd9e909" released by "delete_volume" :: held 0.889s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Created reservations ['fe007ee5-1f9d-4920-9451-b9e32248e1ea', 'da7b98f5-be4b-44de-98db-db2649e63353', 'd82430c8-e85f-4a15-a153-85f31a88dc81', '4142312e-b0ed-4bd4-bdc1-da492f07cf9f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:07 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:07 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (97013dc6-afae-452c-8fbc-6013689bcbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87fc109-4ee5-418c-86dd-69432d953f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87fc109-4ee5-418c-86dd-69432d953f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160194023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b62dbc3-91c2-47c1-b3b7-74955a89aad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:07Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dac9b4c-bb52-4403-a4c0-b58be91dc12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dac9b4c-bb52-4403-a4c0-b58be91dc12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a50f38-cc14-4f01-bb3a-66c6342e58bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a50f38-cc14-4f01-bb3a-66c6342e58bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b62dbc3-91c2-47c1-b3b7-74955a89aad9', 'volume_name': 'volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedbb351-8c38-4733-b841-24d8604571b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedbb351-8c38-4733-b841-24d8604571b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6313b-d75f-4fac-9251-d69785acaaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume 6b62dbc3-91c2-47c1-b3b7-74955a89aad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9', 'volume_size': 1} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a 1073741824" returned: 0 in 0.772s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:07 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.337s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Deleted volume successfully. Sep 08 19:20:07 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a Sep 08 19:20:07 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ae5d1a4f-c3ec-4faa-9abe-8957dca1bc18 tempest-VolumeDependencyTests-1927967957 None] Lock "cinder-e82e7ecd-5e4f-4140-94df-4d07edd9e909-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:07 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794053264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a780194d-d7ad-4fa8-9939-f2b3c838033e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:07Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Creating volume a780194d-d7ad-4fa8-9939-f2b3c838033e {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:07 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcab6e91-7a84-4c79-8286-77ea84cfdd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90bedb2-f785-4767-8baa-4ef7960b1692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a (fd8f6b64-4e47-45ec-9ff0-c0c899072e3a): created successfully Sep 08 19:20:07 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e 1073741824 Sep 08 19:20:07 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90bedb2-f785-4767-8baa-4ef7960b1692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (4e441566-5c34-44ab-bc98-f1485ee8053b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a0ace681-122a-489f-8854-ca811bb01d11 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created volume successfully. Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (7988224d-6fa3-4e60-bcd2-57805e3f7513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afbf53f-18de-45fd-96ac-00ba0d689884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afbf53f-18de-45fd-96ac-00ba0d689884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379311606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b226e7a-4c37-464f-a5d1-6f19c45b5a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:08Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f7aa26-fc65-49b2-883c-2c6a03b5494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f7aa26-fc65-49b2-883c-2c6a03b5494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:07 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae8b79-af26-4412-a9db-e2f17eee3106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ae8b79-af26-4412-a9db-e2f17eee3106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b226e7a-4c37-464f-a5d1-6f19c45b5a49', 'volume_name': 'volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea3c97b-8b27-41b0-bfa9-78ebe88d8571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea3c97b-8b27-41b0-bfa9-78ebe88d8571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63a8caf-0773-4eda-84f6-5f34741ac026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume 0b226e7a-4c37-464f-a5d1-6f19c45b5a49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49', 'volume_size': 1} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (5b08d14e-4673-4f8a-af2d-f9edbad4c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6363f044-3b59-4cc7-ac01-78cf18cd95e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6363f044-3b59-4cc7-ac01-78cf18cd95e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500079518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683392f4-fe0f-4a52-ab63-7e279332023f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:08Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8487bbef-4154-4c8c-8b27-a5004343cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8487bbef-4154-4c8c-8b27-a5004343cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f191fc-4de1-44e8-81de-d35b985d1fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f191fc-4de1-44e8-81de-d35b985d1fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683392f4-fe0f-4a52-ab63-7e279332023f', 'volume_name': 'volume-683392f4-fe0f-4a52-ab63-7e279332023f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df4363e-01b3-4ea4-8a54-e58e5137d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df4363e-01b3-4ea4-8a54-e58e5137d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df3f7fb-d363-4f5b-bd99-a66ffbe05ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume 683392f4-fe0f-4a52-ab63-7e279332023f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683392f4-fe0f-4a52-ab63-7e279332023f', 'volume_size': 1} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:08 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e 1073741824" returned: 0 in 0.773s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:08 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e Sep 08 19:20:08 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:08 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e" returned: 0 in 0.250s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.856s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cab747-164e-4cbf-84df-4fb1ec03ddda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a780194d-d7ad-4fa8-9939-f2b3c838033e', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c551c51e-7d6a-4d81-bd36-530a9d37c61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Creating offline snapshot f44d34a4-cf66-4090-b9aa-8b33f6713979 of volume c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume volume-a780194d-d7ad-4fa8-9939-f2b3c838033e (a780194d-d7ad-4fa8-9939-f2b3c838033e): created successfully Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c551c51e-7d6a-4d81-bd36-530a9d37c61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (8569e9dd-2f76-433b-86c8-b94e0125669b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d2b6d4-7fb6-47f1-aae5-f714d457599a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:08 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f2a3f1ad-cb64-4806-91f9-73e58fd76624 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created volume successfully. Sep 08 19:20:08 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f Sep 08 19:20:08 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:09 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f" returned: 0 in 0.386s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:09 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 1G Sep 08 19:20:09 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:09 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 1G" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c251c2ca-61c5-47a2-83f5-7214144b686f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:09 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c251c2ca-61c5-47a2-83f5-7214144b686f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 Sep 08 19:20:09 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:09 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c251c2ca-61c5-47a2-83f5-7214144b686f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979" returned: 0 in 0.305s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:09 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 is being set with open permissions: ugo+rw Sep 08 19:20:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:09 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 Sep 08 19:20:09 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:10 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979" returned: 0 in 0.252s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:10 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.info Sep 08 19:20:10 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:10 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.info" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:10 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.info is being set with open permissions: ugo+rw Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:10 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.info Sep 08 19:20:10 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:10 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.info" returned: 0 in 0.236s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.366s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160194023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b62dbc3-91c2-47c1-b3b7-74955a89aad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:07Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Creating volume 6b62dbc3-91c2-47c1-b3b7-74955a89aad9 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:10 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:10 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 1073741824 Sep 08 19:20:10 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-35008f5e-4de5-4c74-8f71-a00859c3692c tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-f44d34a4-cf66-4090-b9aa-8b33f6713979-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Lock "cinder-f44d34a4-cf66-4090-b9aa-8b33f6713979-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-c251c2ca-61c5-47a2-83f5-7214144b686f" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-c251c2ca-61c5-47a2-83f5-7214144b686f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-f44d34a4-cf66-4090-b9aa-8b33f6713979" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-f44d34a4-cf66-4090-b9aa-8b33f6713979" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot f44d34a4-cf66-4090-b9aa-8b33f6713979 of volume c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[3defe7f0-eb4d-404e-ae4c-45bfd693166d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:11 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 1073741824" returned: 0 in 0.516s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:11 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 Sep 08 19:20:11 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:11 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 Sep 08 19:20:11 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:11 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979" returned: 0 in 0.391s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c251c2ca-61c5-47a2-83f5-7214144b686f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[17807c99-fa8f-4d7c-ab8c-95947124ce52]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:11 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9" returned: 0 in 0.302s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.617s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6313b-d75f-4fac-9251-d69785acaaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d678f4dd-668a-4697-b951-960346064205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Creating offline snapshot 504bac27-0b5b-4bd2-aa2b-ac79f96925fc of volume fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:11 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 (6b62dbc3-91c2-47c1-b3b7-74955a89aad9): created successfully Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d678f4dd-668a-4697-b951-960346064205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (97013dc6-afae-452c-8fbc-6013689bcbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d686149-8ba7-40bb-ae5e-6e7115cee172]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:11 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-82494e85-3bb8-4824-baaa-3ee61605601c tempest-CreateVolumesFromSnapshotTest-460795674 None] Created volume successfully. Sep 08 19:20:11 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f Sep 08 19:20:11 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:11 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a Sep 08 19:20:11 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:11 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f" returned: 0 in 0.403s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:11 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 Sep 08 19:20:11 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:11 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" returned: 0 in 0.405s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:11 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc 1G Sep 08 19:20:11 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:12 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979" returned: 0 in 0.389s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:12 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979 Sep 08 19:20:12 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:12 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc 1G" returned: 0 in 0.522s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:12 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc Sep 08 19:20:12 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:12 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f.f44d34a4-cf66-4090-b9aa-8b33f6713979" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-f44d34a4-cf66-4090-b9aa-8b33f6713979" released by "_delete_snapshot" :: held 1.573s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-c251c2ca-61c5-47a2-83f5-7214144b686f" released by "delete_snapshot" :: held 1.601s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Created reservations ['7493dac6-41a0-4a9f-862d-27832571df67', '84a0a53b-3e6c-4f69-8bcc-4cc41df24c70', '24f9a12d-5757-464b-b08a-5054ee33c2ba', 'b9edb9e7-6468-4f25-ace2-025af329a116'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8a2d12b-a4df-42df-92e2-df6e554f3ea2 tempest-ProjectMemberTests-823681440 None] Lock "cinder-f44d34a4-cf66-4090-b9aa-8b33f6713979-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:12 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc" returned: 0 in 0.342s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:12 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc is being set with open permissions: ugo+rw Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:12 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc Sep 08 19:20:12 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Flow 'volume_create_manager' (ad8ef934-1c31-4702-b485-ebc493513c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332af3db-2a7e-4d5a-af43-e3e800613357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (332af3db-2a7e-4d5a-af43-e3e800613357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47b6901-46f5-420d-9883-429b1ebd9333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9278755201f44768831ee14dfa637fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:13Z,use_quota=True,user_id='5b0662a4070045438a5045b6af56ef89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee38bf4-2903-4a53-aa4d-2d2423670fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee38bf4-2903-4a53-aa4d-2d2423670fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4c5390-f260-4743-93ce-7a8cb7a23165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.image.glance [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Creating Keystone auth plugin from conf {{(pid=87538) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:20:13 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc" returned: 0 in 0.271s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-c251c2ca-61c5-47a2-83f5-7214144b686f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Lock "cinder-c251c2ca-61c5-47a2-83f5-7214144b686f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:13 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.info Sep 08 19:20:13 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-c251c2ca-61c5-47a2-83f5-7214144b686f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-c251c2ca-61c5-47a2-83f5-7214144b686f" acquired by "delete_volume" :: waited 0.013s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc4edf8-ee35-4ebb-9087-fb1482d9a540]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4c5390-f260-4743-93ce-7a8cb7a23165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f47b6901-46f5-420d-9883-429b1ebd9333', 'volume_name': 'volume-f47b6901-46f5-420d-9883-429b1ebd9333', 'volume_size': 1, 'image_id': '6dab1f42-1a12-472f-b485-59b313385fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dab1f42-1a12-472f-b485-59b313385fc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09e2fbf76b9cccc713bd7e6281f67ff3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9278755201f44768831ee14dfa637fa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a469be2d11433a51eea463a02a049a09b592ea0fd9f3f8ec549811309361ab2e9fab4966d885ed9d416d470f448964cd59136a5ec35bde73aa6d0b25a1536a92', 'id': '6dab1f42-1a12-472f-b485-59b313385fc9', 'created_at': datetime.datetime(2026, 9, 8, 17, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 20, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dab1f42-1a12-472f-b485-59b313385fc9/file', 'properties': {}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5350f87c-3e14-4397-8301-4c4ae4416654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5350f87c-3e14-4397-8301-4c4ae4416654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7857baf4-d2ca-46cf-9412-d44b9fef857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:13 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Volume f47b6901-46f5-420d-9883-429b1ebd9333: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f47b6901-46f5-420d-9883-429b1ebd9333', 'volume_size': 1, 'image_id': '6dab1f42-1a12-472f-b485-59b313385fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dab1f42-1a12-472f-b485-59b313385fc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09e2fbf76b9cccc713bd7e6281f67ff3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9278755201f44768831ee14dfa637fa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a469be2d11433a51eea463a02a049a09b592ea0fd9f3f8ec549811309361ab2e9fab4966d885ed9d416d470f448964cd59136a5ec35bde73aa6d0b25a1536a92', 'id': '6dab1f42-1a12-472f-b485-59b313385fc9', 'created_at': datetime.datetime(2026, 9, 8, 17, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 20, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dab1f42-1a12-472f-b485-59b313385fc9/file', 'properties': {}}, 'image_service': } Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Trying to clone f47b6901-46f5-420d-9883-429b1ebd9333 from image 6dab1f42-1a12-472f-b485-59b313385fc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6dab1f42-1a12-472f-b485-59b313385fc9', 'metadata': {}}]). {{(pid=87538) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:20:13 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f Sep 08 19:20:13 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.info" returned: 0 in 0.289s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.info is being set with open permissions: ugo+rw Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.info Sep 08 19:20:13 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:20:13 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdb2b8-fa4b-41b5-86ff-e633a2e04c52]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD Sep 08 19:20:13 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f Sep 08 19:20:13 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.info" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.698s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379311606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b226e7a-4c37-464f-a5d1-6f19c45b5a49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:08Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Creating volume 0b226e7a-4c37-464f-a5d1-6f19c45b5a49 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:13 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 1073741824 Sep 08 19:20:13 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-26645761-b8dc-42a9-94a9-f6ac263fd4f2 tempest-CinderUnicodeTest-1428321800 None] Create snapshot completed successfully Sep 08 19:20:13 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-c251c2ca-61c5-47a2-83f5-7214144b686f" returned: 0 in 0.285s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-c251c2ca-61c5-47a2-83f5-7214144b686f" released by "delete_volume" :: held 0.762s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "cinder-504bac27-0b5b-4bd2-aa2b-ac79f96925fc-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-504bac27-0b5b-4bd2-aa2b-ac79f96925fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "cinder-quobyte-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:14 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD Sep 08 19:20:14 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Created reservations ['fc2cf0b6-3dc8-4290-91e5-ada43c5f2a3e', 'f4415614-9b9a-48f3-96f8-35d45f493ef9', '296c12d6-c59f-4942-b8ea-6dc2c8df511b', 'b4d04448-ddb8-4d34-88e9-74e0e11cb059'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "cinder-quobyte-504bac27-0b5b-4bd2-aa2b-ac79f96925fc" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-504bac27-0b5b-4bd2-aa2b-ac79f96925fc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Deleting offline snapshot 504bac27-0b5b-4bd2-aa2b-ac79f96925fc of volume fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] snapshot_file for this snap is: volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d6e012-c606-4d0b-befc-5b45c7eac041]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:14 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:14 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:14 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc Sep 08 19:20:14 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 1073741824" returned: 0 in 0.585s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:14 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Temporary image 6dab1f42-1a12-472f-b485-59b313385fc9 is fetched for user 5b0662a4070045438a5045b6af56ef89. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 Sep 08 19:20:14 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a01f50a-2f15-4b9f-afd6-ff4b2842fc75]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.332s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:14 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9ded823c-7740-4d3c-a760-0cf3df4247d4 tempest-ProjectMemberTests-823681440 None] Lock "cinder-c251c2ca-61c5-47a2-83f5-7214144b686f-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:14 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc" returned: 0 in 0.559s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:14 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD Sep 08 19:20:14 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:14 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.462s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500079518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683392f4-fe0f-4a52-ab63-7e279332023f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc27fd1d25a47398a621907ec9ba626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:08Z,use_quota=True,user_id='78523baf95004d07978485091f40c7f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Creating volume 683392f4-fe0f-4a52-ab63-7e279332023f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:14 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a17f99d-e432-449e-8499-3cb64876efa5]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f 1073741824 Sep 08 19:20:14 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63a8caf-0773-4eda-84f6-5f34741ac026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7338a4-06bd-4c5c-b50b-1fcf82306f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:14 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 (0b226e7a-4c37-464f-a5d1-6f19c45b5a49): created successfully Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7338a4-06bd-4c5c-b50b-1fcf82306f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:14 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (7988224d-6fa3-4e60-bcd2-57805e3f7513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:14 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-43db2fb4-985b-4582-9164-0f75e7dcd396 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created volume successfully. Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (d0332509-d216-4063-a67f-66296486a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:15 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a Sep 08 19:20:15 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5ca6f4-abd5-49a1-87b9-0afd6ca85d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5ca6f4-abd5-49a1-87b9-0afd6ca85d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10049538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98a60b5-ce01-4434-860f-31f276fb667f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:15Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fa63b5-6009-4716-a231-c519f84ece3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fa63b5-6009-4716-a231-c519f84ece3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2823ef-d71c-48dd-8e49-bd8da5800b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2823ef-d71c-48dd-8e49-bd8da5800b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98a60b5-ce01-4434-860f-31f276fb667f', 'volume_name': 'volume-b98a60b5-ce01-4434-860f-31f276fb667f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1924a79c-ea94-4c3d-a40e-666537d388ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1924a79c-ea94-4c3d-a40e-666537d388ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7c580a-0f27-4df4-8023-f75f55e79904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:15 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Volume b98a60b5-ce01-4434-860f-31f276fb667f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98a60b5-ce01-4434-860f-31f276fb667f', 'volume_size': 1} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:15 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD Sep 08 19:20:15 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f 1073741824" returned: 0 in 0.557s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" returned: 0 in 0.586s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:15 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f Sep 08 19:20:15 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc Sep 08 19:20:15 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:15 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f" returned: 0 in 0.258s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10049538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98a60b5-ce01-4434-860f-31f276fb667f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:15Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Creating volume b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:15 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:15 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f 1073741824 Sep 08 19:20:15 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df3f7fb-d363-4f5b-bd99-a66ffbe05ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683392f4-fe0f-4a52-ab63-7e279332023f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce64c6c3-fdb6-4b02-8cc2-d0a8ed323ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:15 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Volume volume-683392f4-fe0f-4a52-ab63-7e279332023f (683392f4-fe0f-4a52-ab63-7e279332023f): created successfully Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce64c6c3-fdb6-4b02-8cc2-d0a8ed323ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Flow 'volume_create_manager' (5b08d14e-4673-4f8a-af2d-f9edbad4c83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5264dc7a-9bdc-4a19-bc09-9871b8839b6d tempest-CreateVolumesFromSnapshotTest-460795674 None] Created volume successfully. Sep 08 19:20:15 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc" returned: 0 in 0.388s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:15 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc Sep 08 19:20:15 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-683392f4-fe0f-4a52-ab63-7e279332023f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-683392f4-fe0f-4a52-ab63-7e279332023f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-683392f4-fe0f-4a52-ab63-7e279332023f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-683392f4-fe0f-4a52-ab63-7e279332023f" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00a423a-eeef-430e-8e1d-2879423c4446]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:16 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a.504bac27-0b5b-4bd2-aa2b-ac79f96925fc" returned: 0 in 0.350s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:16 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f Sep 08 19:20:16 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:16 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f 1073741824" returned: 0 in 0.514s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-504bac27-0b5b-4bd2-aa2b-ac79f96925fc" released by "_delete_snapshot" :: held 2.041s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" released by "delete_snapshot" :: held 2.080s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:16 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f Sep 08 19:20:16 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Created reservations ['aea975dc-bf49-4f9e-833b-5707a3126936', 'c1051b1c-c183-4bdb-9408-79b41a9b66c3', '99fb3489-38fc-4a43-b5e0-8eecced13ff6', '62933302-5666-4055-88dd-8739b5292c1d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Delete snapshot completed successfully. Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b7a59466-7b35-413a-b1b9-2777ffbfb4ae tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-504bac27-0b5b-4bd2-aa2b-ac79f96925fc-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:16 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f" returned: 0 in 0.403s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:16 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f Sep 08 19:20:16 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:16 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47b6901-46f5-420d-9883-429b1ebd9333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9278755201f44768831ee14dfa637fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:13Z,use_quota=True,user_id='5b0662a4070045438a5045b6af56ef89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Creating volume f47b6901-46f5-420d-9883-429b1ebd9333 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:16 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7c580a-0f27-4df4-8023-f75f55e79904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98a60b5-ce01-4434-860f-31f276fb667f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:16 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 1073741824 Sep 08 19:20:16 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703a7d0f-7be6-46af-ab0d-f1164cfc49c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:16 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Volume volume-b98a60b5-ce01-4434-860f-31f276fb667f (b98a60b5-ce01-4434-860f-31f276fb667f): created successfully Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703a7d0f-7be6-46af-ab0d-f1164cfc49c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (d0332509-d216-4063-a67f-66296486a54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:16 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-25e98072-fe2f-4c57-9f5f-facaa83d512d tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:20:16 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-683392f4-fe0f-4a52-ab63-7e279332023f" returned: 0 in 0.265s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-683392f4-fe0f-4a52-ab63-7e279332023f" released by "delete_volume" :: held 0.707s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Created reservations ['6f442a9c-08cf-40e4-af05-a64ed8561256', '58f23b4b-d6df-431d-ae17-46d4764f88ae', '417d0512-1acf-434d-bd3a-d4371472d3e9', 'ced19eec-6cb1-481c-aeb1-f564271c8696'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:16 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:16 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 1073741824" returned: 0 in 0.487s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 Sep 08 19:20:17 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.318s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-0b226e7a-4c37-464f-a5d1-6f19c45b5a49-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:17 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Deleted volume successfully. Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-0b226e7a-4c37-464f-a5d1-6f19c45b5a49-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-eb98ee44-67ac-40e1-bb00-620681b7ec7c tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-683392f4-fe0f-4a52-ab63-7e279332023f-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-0b226e7a-4c37-464f-a5d1-6f19c45b5a49" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-0b226e7a-4c37-464f-a5d1-6f19c45b5a49" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b65a1ae-2f0f-475e-a7dd-13eba06a9de0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "cinder-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:17 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333" returned: 0 in 0.358s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.169s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "cinder-quobyte-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Creating offline snapshot 5ed8dae3-6b81-487e-94e6-7eb4b4119e87 of volume b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Attempting download of 6dab1f42-1a12-472f-b485-59b313385fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dab1f42-1a12-472f-b485-59b313385fc9', 'metadata': {}}])) to volume f47b6901-46f5-420d-9883-429b1ebd9333. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:20:17 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:17 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc92377-ddc9-4f73-bbea-633fe826642a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ef3c5-c7ab-4856-bc34-186a0a4bf9a1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c577385-a0db-48f7-86cd-d8ff4efecd3c]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dab1f42-1a12-472f-b485-59b313385fc9_bvg0j0aj {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f Sep 08 19:20:17 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a Sep 08 19:20:17 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dab1f42-1a12-472f-b485-59b313385fc9_bvg0j0aj Sep 08 19:20:17 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49" returned: 0 in 0.450s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49 Sep 08 19:20:17 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:17 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f" returned: 0 in 0.434s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:17 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" returned: 0 in 0.431s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6dab1f42-1a12-472f-b485-59b313385fc9_bvg0j0aj" returned: 0 in 0.389s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dab1f42-1a12-472f-b485-59b313385fc9_bvg0j0aj {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:17 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 1G Sep 08 19:20:17 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:17 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a Sep 08 19:20:17 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:18 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-0b226e7a-4c37-464f-a5d1-6f19c45b5a49" returned: 0 in 0.290s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:18 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dab1f42-1a12-472f-b485-59b313385fc9_bvg0j0aj Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-0b226e7a-4c37-464f-a5d1-6f19c45b5a49" released by "delete_volume" :: held 0.801s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:18 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created reservations ['3e1eff30-695f-4e1e-95e5-a8b945f4c172', '537f74b2-475e-4a4d-a8b2-d6abb1cef20d', '4cafebf4-0663-4e24-af2b-a2ea7911763c', '8eb30fd1-538d-4fe5-b1a3-c73c4bb276be'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:18 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" returned: 0 in 0.282s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a" released by "delete_volume" :: held 0.797s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:18 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:18 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:18 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Created reservations ['bb5a053f-d93c-4c44-bfed-1f5dea0b423f', 'd30513b6-f4e5-4b7f-953c-63b6d3d1f364', '2bb624df-d004-4b02-8336-ad0e3fa70e1c', 'b7d572ea-81af-4322-a3d6-2352e6cff6ad'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dab1f42-1a12-472f-b485-59b313385fc9_bvg0j0aj" returned: 1 in 0.462s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6dab1f42-1a12-472f-b485-59b313385fc9_bvg0j0aj' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aca66b-82ca-4b2b-b025-8396c6ad47ee]: (4, 'raw') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-6b62dbc3-91c2-47c1-b3b7-74955a89aad9-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:18 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 1G" returned: 0 in 0.578s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98a60b5-ce01-4434-860f-31f276fb667f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-6b62dbc3-91c2-47c1-b3b7-74955a89aad9-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:18 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98a60b5-ce01-4434-860f-31f276fb667f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 Sep 08 19:20:18 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:18 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD Sep 08 19:20:18 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-6b62dbc3-91c2-47c1-b3b7-74955a89aad9" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:18 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.362s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-6b62dbc3-91c2-47c1-b3b7-74955a89aad9" acquired by "delete_volume" :: waited 0.062s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:18 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:18 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:18 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Deleted volume successfully. Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17f782-a824-47ea-ab6f-4d3ce43841a5]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5a114762-2a5e-4105-ad58-07512dd471c9 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-0b226e7a-4c37-464f-a5d1-6f19c45b5a49-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:18 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:18 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 Sep 08 19:20:18 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:18 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98a60b5-ce01-4434-860f-31f276fb667f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87" returned: 0 in 0.377s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:18 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 is being set with open permissions: ugo+rw Sep 08 19:20:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:18 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 Sep 08 19:20:18 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.354s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:19 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD Sep 08 19:20:19 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Deleted volume successfully. Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6ddd7e8c-a41f-481e-9b32-9933ef5f4736 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-fa3a39d4-c5ed-4606-a905-14e9b1b8fa5a-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:19 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9" returned: 0 in 0.446s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87" returned: 0 in 0.284s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:UPDATE=272,cinder:SELECT=217,cinder:INSERT=77,cinder:DELETE=29 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:20:19 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9 Sep 08 19:20:19 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] 6dab1f42-1a12-472f-b485-59b313385fc9 was raw, converting to qcow2 {{(pid=87538) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:20:19 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.info Sep 08 19:20:19 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 Sep 08 19:20:19 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-6b62dbc3-91c2-47c1-b3b7-74955a89aad9" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-6b62dbc3-91c2-47c1-b3b7-74955a89aad9" released by "delete_volume" :: held 0.771s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=207,cinder:UPDATE=289,cinder:DELETE=23,cinder:INSERT=68 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:20:19 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.info" returned: 0 in 0.284s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.info is being set with open permissions: ugo+rw Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created reservations ['64366a9f-acb6-454f-8be1-bc5064403ba7', '287a9928-e6be-402d-bc66-122373e0ab0d', 'd6b7f9b1-04f3-421f-a0b2-2e9dcbb3777f', 'eafaa7a9-5b18-4ec3-a569-f4e2586f7dcc'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:19 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.info Sep 08 19:20:19 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "cinder-d1ef6483-b0e4-4958-948a-466575c2d797-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:19 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:19 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-a780194d-d7ad-4fa8-9939-f2b3c838033e-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-d1ef6483-b0e4-4958-948a-466575c2d797-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-a780194d-d7ad-4fa8-9939-f2b3c838033e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "cinder-quobyte-d1ef6483-b0e4-4958-948a-466575c2d797" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-a780194d-d7ad-4fa8-9939-f2b3c838033e" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-d1ef6483-b0e4-4958-948a-466575c2d797" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-a780194d-d7ad-4fa8-9939-f2b3c838033e" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[631275cc-8be8-415b-af95-9ea1fa96a63a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71ff371-fa30-4cba-881a-2ac951af6a9f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.info" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:19 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9e03e1e2-9b76-4e44-a001-649598fc8199 tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:20:19 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.349s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:19 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333" returned: 0 in 0.714s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6dab1f42-1a12-472f-b485-59b313385fc9_dqmy01k0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:20:19 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:20:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Deleted volume successfully. Sep 08 19:20:20 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 Sep 08 19:20:20 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e Sep 08 19:20:20 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 1G Sep 08 19:20:20 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-589fcfed-d91f-4467-92f4-ed2d9abb8733 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-6b62dbc3-91c2-47c1-b3b7-74955a89aad9-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:20 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797" returned: 0 in 0.433s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e" returned: 0 in 0.431s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797 Sep 08 19:20:20 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e Sep 08 19:20:20 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 1G" returned: 0 in 0.358s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Downloaded image 6dab1f42-1a12-472f-b485-59b313385fc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6dab1f42-1a12-472f-b485-59b313385fc9', 'metadata': {}}])) to volume f47b6901-46f5-420d-9883-429b1ebd9333 successfully. {{(pid=87538) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Temporary image 6dab1f42-1a12-472f-b485-59b313385fc9 for user 5b0662a4070045438a5045b6af56ef89 is deleted. {{(pid=87538) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.volume_utils [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Marking volume f47b6901-46f5-420d-9883-429b1ebd9333 as bootable. {{(pid=87538) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Copying metadata from image 6dab1f42-1a12-472f-b485-59b313385fc9 to f47b6901-46f5-420d-9883-429b1ebd9333. {{(pid=87538) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Creating volume glance metadata for volume f47b6901-46f5-420d-9883-429b1ebd9333 backed by image 6dab1f42-1a12-472f-b485-59b313385fc9 with: {'image_id': '6dab1f42-1a12-472f-b485-59b313385fc9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '09e2fbf76b9cccc713bd7e6281f67ff3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87538) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-5ed8dae3-6b81-487e-94e6-7eb4b4119e87-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Lock "cinder-5ed8dae3-6b81-487e-94e6-7eb4b4119e87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-b98a60b5-ce01-4434-860f-31f276fb667f" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7857baf4-d2ca-46cf-9412-d44b9fef857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47b6901-46f5-420d-9883-429b1ebd9333', 'volume_size': 1, 'image_id': '6dab1f42-1a12-472f-b485-59b313385fc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6dab1f42-1a12-472f-b485-59b313385fc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09e2fbf76b9cccc713bd7e6281f67ff3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9278755201f44768831ee14dfa637fa3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a469be2d11433a51eea463a02a049a09b592ea0fd9f3f8ec549811309361ab2e9fab4966d885ed9d416d470f448964cd59136a5ec35bde73aa6d0b25a1536a92', 'id': '6dab1f42-1a12-472f-b485-59b313385fc9', 'created_at': datetime.datetime(2026, 9, 8, 17, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 20, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6dab1f42-1a12-472f-b485-59b313385fc9/file', 'properties': {}}, 'image_service': }' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4906aab0-12b5-46fe-a0a0-98ff41cf8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-b98a60b5-ce01-4434-860f-31f276fb667f" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-5ed8dae3-6b81-487e-94e6-7eb4b4119e87" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:20 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Volume volume-f47b6901-46f5-420d-9883-429b1ebd9333 (f47b6901-46f5-420d-9883-429b1ebd9333): created successfully Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4906aab0-12b5-46fe-a0a0-98ff41cf8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Flow 'volume_create_manager' (ad8ef934-1c31-4702-b485-ebc493513c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-5ed8dae3-6b81-487e-94e6-7eb4b4119e87" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot 5ed8dae3-6b81-487e-94e6-7eb4b4119e87 of volume b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-576fa725-d8ce-4cc2-b373-62d589f6874f tempest-VolumeImageDependencyTests-437344723 None] Created volume successfully. Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[513dc4b7-efe6-4482-8b1a-4d3c28b27592]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-d1ef6483-b0e4-4958-948a-466575c2d797" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-quobyte-d1ef6483-b0e4-4958-948a-466575c2d797" released by "delete_volume" :: held 0.798s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:20 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-a780194d-d7ad-4fa8-9939-f2b3c838033e" returned: 0 in 0.337s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-a780194d-d7ad-4fa8-9939-f2b3c838033e" released by "delete_volume" :: held 0.827s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:20 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 Sep 08 19:20:20 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Created reservations ['bcddbe0b-d46d-44b0-9e39-1ec5a9fcfbd9', 'b5f5a658-3a52-4f8b-a9ab-105d819543f0', '36076c10-41c1-424a-a0f5-6cb7adfa3497', '1c6eadeb-508c-41d5-9b6f-b0a77c5c4e8f'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Created reservations ['00670a25-7275-41d7-9dbb-6ec2dc6ae5bc', 'daf46353-85ca-4f2a-abe3-b7e9d39d7045', '8d92f246-26f7-431c-8a83-484c41168cc6', 'cbd83c18-821a-4760-bae3-fc0393929dd1'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:20 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:20 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:20 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:21 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87" returned: 0 in 0.519s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b98a60b5-ce01-4434-860f-31f276fb667f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[a317a5af-ea96-4780-ab90-2d2d76b13175]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[438bd2b8-a40f-4543-962d-b571446af9d0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:21 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.406s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:21 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Deleted volume successfully. Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-02cbffc0-26aa-48c9-9b24-0ff01f5a91c8 tempest-CinderUnicodeTest-1428321800 None] Lock "cinder-d1ef6483-b0e4-4958-948a-466575c2d797-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:21 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a Sep 08 19:20:21 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:21 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.475s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:21 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Deleted volume successfully. Sep 08 19:20:21 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f Sep 08 19:20:21 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8547caa1-d194-4b3f-9648-0d2e7407dedd tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-a780194d-d7ad-4fa8-9939-f2b3c838033e-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:21 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a" returned: 0 in 0.466s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:21 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f" returned: 0 in 0.475s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:21 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a Sep 08 19:20:21 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:21 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 Sep 08 19:20:21 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Acquiring lock "cinder-f47b6901-46f5-420d-9883-429b1ebd9333-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Lock "cinder-f47b6901-46f5-420d-9883-429b1ebd9333-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Acquiring lock "cinder-quobyte-f47b6901-46f5-420d-9883-429b1ebd9333" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Lock "cinder-quobyte-f47b6901-46f5-420d-9883-429b1ebd9333" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc2e177-412d-4272-8709-bea3aaadf34e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:22 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a" returned: 0 in 0.400s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a" released by "delete_volume" :: held 0.953s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:22 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 Sep 08 19:20:22 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created reservations ['002da474-cf48-4b63-b300-43bdb3879edf', '76e1d9da-a789-40c9-91bb-9779d6706609', '17fcb380-77af-490b-a024-d1bf02839b34', '931634d4-5ff6-44c4-ac7e-5f4d9f201c1a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:22 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87" returned: 0 in 0.501s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:22 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87 Sep 08 19:20:22 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:22 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:22 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:22 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333" returned: 0 in 0.475s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:22 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333 Sep 08 19:20:22 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:22 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f.5ed8dae3-6b81-487e-94e6-7eb4b4119e87" returned: 0 in 0.323s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-5ed8dae3-6b81-487e-94e6-7eb4b4119e87" released by "_delete_snapshot" :: held 1.962s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:22 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-b98a60b5-ce01-4434-860f-31f276fb667f" released by "delete_snapshot" :: held 2.020s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Deleted volume successfully. Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-326cfde7-55b9-4963-9e8d-89c533159e25 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-fd8f6b64-4e47-45ec-9ff0-c0c899072e3a-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Created reservations ['1e875ad8-61d2-4115-abc7-eb43c2c0dccb', '70e8b10e-77d7-49d4-95bf-3e22a5620836', '89e59aec-30e3-43d2-84d4-af10d94fa6a5', '35082d3d-3e7e-40e5-af5a-8a98af634601'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7682a796-cc9a-41d7-9b83-762473a0580a tempest-ProjectMemberTests-823681440 None] Lock "cinder-5ed8dae3-6b81-487e-94e6-7eb4b4119e87-delete_snapshot" released by "delete_snapshot" :: held 2.240s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:22 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f47b6901-46f5-420d-9883-429b1ebd9333" returned: 0 in 0.335s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Lock "cinder-quobyte-f47b6901-46f5-420d-9883-429b1ebd9333" released by "delete_volume" :: held 0.875s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Created reservations ['96e10590-53f2-483e-ba80-02193091217d', 'd8b2b5d2-5cfc-4cd2-9101-243ffc4254df', '08118e7b-c9b1-4c93-9750-836c4a37f421', 'c274dbee-ea3a-4d62-94b3-28bcf19140d1'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:22 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:22 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:23 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.323s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:23 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Deleted volume successfully. Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b1d43c80-01db-4959-b1ac-cfc8f1df2e6c tempest-VolumeImageDependencyTests-437344723 None] Lock "cinder-f47b6901-46f5-420d-9883-429b1ebd9333-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-27b2f787-71eb-4089-b772-b9cb383cef0f-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-27b2f787-71eb-4089-b772-b9cb383cef0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-3094b7c3-c520-45be-b1e8-b57c102db32b" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-3094b7c3-c520-45be-b1e8-b57c102db32b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-27b2f787-71eb-4089-b772-b9cb383cef0f" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-27b2f787-71eb-4089-b772-b9cb383cef0f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Deleting offline snapshot 27b2f787-71eb-4089-b772-b9cb383cef0f of volume 3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] snapshot_file for this snap is: volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae9b3fb-2a48-446b-8085-217600c872a4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:23 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f Sep 08 19:20:23 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-b98a60b5-ce01-4434-860f-31f276fb667f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Lock "cinder-b98a60b5-ce01-4434-860f-31f276fb667f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-b98a60b5-ce01-4434-860f-31f276fb667f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-b98a60b5-ce01-4434-860f-31f276fb667f" acquired by "delete_volume" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2299ab8-a1c9-4140-906c-2685b1086da8]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:23 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f" returned: 0 in 0.490s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3094b7c3-c520-45be-b1e8-b57c102db32b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[00828088-f4d4-47d2-974c-311f36c91c05]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:24 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f Sep 08 19:20:24 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:24 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b Sep 08 19:20:24 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:24 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f" returned: 0 in 0.495s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:24 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f Sep 08 19:20:24 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:24 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b" returned: 0 in 0.556s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:24 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f Sep 08 19:20:24 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:24 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b98a60b5-ce01-4434-860f-31f276fb667f" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-b98a60b5-ce01-4434-860f-31f276fb667f" released by "delete_volume" :: held 0.893s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Created reservations ['199d33b5-2606-4a59-914c-e908e2af9fb5', 'dcf5b87c-1b5a-4a19-930f-43ba46f971b0', '784bf1cc-31bb-4f3b-b15d-b64dd49229fe', '5fa1de24-7b65-4ab8-aa82-2c40f8095686'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:24 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:24 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:25 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f" returned: 0 in 0.546s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:25 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f Sep 08 19:20:25 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:25 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.481s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:20:25 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b.27b2f787-71eb-4089-b772-b9cb383cef0f" returned: 0 in 0.413s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-cfd45571-ca14-40d2-a504-768b310455de tempest-ProjectAdminTests-1746393637 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4696960449219, 'free_capacity_gb': 1773.4696960449219, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87538) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-9e311ab1-b886-4bcd-855b-a940c8ceb8f6 tempest-ProjectMemberTests-823681440 None] Lock "cinder-b98a60b5-ce01-4434-860f-31f276fb667f-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-27b2f787-71eb-4089-b772-b9cb383cef0f" released by "_delete_snapshot" :: held 2.214s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-3094b7c3-c520-45be-b1e8-b57c102db32b" released by "delete_snapshot" :: held 2.249s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Created reservations ['c86431ea-9da6-47c0-a9ad-9f6d840b459f', 'd430eac2-12bf-4111-9155-e79420c3e85d', '195d238e-0e05-42d3-8c02-60f10d9e875f', '5ea60634-1280-4610-b387-7bf96a742db0'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (d031885f-68b3-40be-9f3b-84dee780688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c09bb66-274c-4ccb-ad94-123727ebb37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c09bb66-274c-4ccb-ad94-123727ebb37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029342352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:26Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bffbcd9-f6d6-420e-9af2-6561f17bb0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bffbcd9-f6d6-420e-9af2-6561f17bb0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d032433-2f2d-4031-8f29-131fa04270a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d032433-2f2d-4031-8f29-131fa04270a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f', 'volume_name': 'volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d69105-3fde-47ac-b831-28803c900f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d69105-3fde-47ac-b831-28803c900f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ac37a5-286e-433c-8051-bdde4f67ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:25 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Volume 74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f', 'volume_size': 1} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029342352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:26Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Creating volume 74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:25 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:25 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f 1073741824 Sep 08 19:20:25 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Delete snapshot completed successfully. Sep 08 19:20:25 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-13361132-8d3b-406e-b340-dfc82a2affac tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-27b2f787-71eb-4089-b772-b9cb383cef0f-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:26 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f 1073741824" returned: 0 in 0.557s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:26 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f Sep 08 19:20:26 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-3094b7c3-c520-45be-b1e8-b57c102db32b-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-3094b7c3-c520-45be-b1e8-b57c102db32b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "cinder-quobyte-3094b7c3-c520-45be-b1e8-b57c102db32b" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-3094b7c3-c520-45be-b1e8-b57c102db32b" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb5e6dd-a842-4a61-9368-8ce5fcb80efe]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:26 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" returned: 0 in 0.392s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ac37a5-286e-433c-8051-bdde4f67ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dc72d4-c3f2-45a2-934e-b2bd481b7c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:26 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Volume volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f (74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f): created successfully Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58dc72d4-c3f2-45a2-934e-b2bd481b7c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:26 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (d031885f-68b3-40be-9f3b-84dee780688a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-85fff6ba-fe4b-4219-900a-9cd3c42eb752 tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:20:26 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b Sep 08 19:20:26 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:27 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b" returned: 0 in 0.474s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:27 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b Sep 08 19:20:27 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:27 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3094b7c3-c520-45be-b1e8-b57c102db32b" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-quobyte-3094b7c3-c520-45be-b1e8-b57c102db32b" released by "delete_volume" :: held 0.873s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Created reservations ['c31cc8b2-4c25-4068-bc0b-1a9dfcc77787', '24c36fe5-e9da-4bd0-bb91-6307408ad560', '7fe7935f-c941-4f35-baa5-a0dd96752cbe', 'f310c88f-5413-4709-b5fc-d22cd99759fd'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:27 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:27 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:28 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Creating offline snapshot 62bf8cbc-d969-407e-acad-4c9909efd42d of volume 74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.412s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:28 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Deleted volume successfully. Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab6359-4d71-4578-8bf1-ab2df9f071e1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5e8643e8-767b-494d-8e75-1ea8129e3968 tempest-CreateVolumesFromSnapshotTest-460795674 None] Lock "cinder-3094b7c3-c520-45be-b1e8-b57c102db32b-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:28 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f Sep 08 19:20:28 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (45b4899b-86a1-4aeb-a53f-9f7d5fffb0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:28 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2d4e53-5076-4fc5-9860-956f59c5859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" returned: 0 in 0.536s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2d4e53-5076-4fc5-9860-956f59c5859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373533241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85446d94-1fe8-4973-9efc-80580372ade8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:29Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d 1G Sep 08 19:20:28 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7272888b-3cf8-4733-bfac-fdd12a43dcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7272888b-3cf8-4733-bfac-fdd12a43dcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9877d2ba-5bda-4dbb-85e2-971d619eaefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9877d2ba-5bda-4dbb-85e2-971d619eaefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85446d94-1fe8-4973-9efc-80580372ade8', 'volume_name': 'volume-85446d94-1fe8-4973-9efc-80580372ade8', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfda378-5841-49c0-9341-b21b7a5e6d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfda378-5841-49c0-9341-b21b7a5e6d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc7e74-9e22-47c6-a74d-26d9bdf34023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Volume 85446d94-1fe8-4973-9efc-80580372ade8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85446d94-1fe8-4973-9efc-80580372ade8', 'volume_size': 1} Sep 08 19:20:28 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:29 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d 1G" returned: 0 in 0.561s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:29 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d Sep 08 19:20:29 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:29 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d" returned: 0 in 0.370s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:29 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d is being set with open permissions: ugo+rw Sep 08 19:20:29 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:29 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d Sep 08 19:20:29 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:29 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d" returned: 0 in 0.287s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:30 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.info Sep 08 19:20:30 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:30 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.info" returned: 0 in 0.306s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:30 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.info is being set with open permissions: ugo+rw Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:30 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.info Sep 08 19:20:30 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:30 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.info" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373533241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85446d94-1fe8-4973-9efc-80580372ade8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:29Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Creating volume 85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:30 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:30 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:30 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 1073741824 Sep 08 19:20:30 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:30 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9f3e7dc0-f955-42aa-99b2-d8e4a0403abd tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:20:31 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 1073741824" returned: 0 in 0.455s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:31 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 Sep 08 19:20:31 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-62bf8cbc-d969-407e-acad-4c9909efd42d-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Lock "cinder-62bf8cbc-d969-407e-acad-4c9909efd42d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-62bf8cbc-d969-407e-acad-4c9909efd42d" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-62bf8cbc-d969-407e-acad-4c9909efd42d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot 62bf8cbc-d969-407e-acad-4c9909efd42d of volume 74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:31 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8" returned: 0 in 0.367s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b598be4-d84a-46ae-9c30-7ea507c5c8aa]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25fc7e74-9e22-47c6-a74d-26d9bdf34023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85446d94-1fe8-4973-9efc-80580372ade8', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6833f59-8934-4a91-b6e1-8a22ce08e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Volume volume-85446d94-1fe8-4973-9efc-80580372ade8 (85446d94-1fe8-4973-9efc-80580372ade8): created successfully Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6833f59-8934-4a91-b6e1-8a22ce08e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (45b4899b-86a1-4aeb-a53f-9f7d5fffb0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-21000016-6eb1-4409-88dc-f5359cb8fa71 tempest-ProjectReaderTests-1015780814 None] Created volume successfully. Sep 08 19:20:31 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d Sep 08 19:20:31 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:32 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d" returned: 0 in 0.519s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba023b-5737-48da-85e4-3aefe26cdff0]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:32 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f Sep 08 19:20:32 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Creating offline snapshot 8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 of volume 85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[362d8848-ec48-4248-85df-f39928103c00]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:32 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 Sep 08 19:20:32 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:32 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" returned: 0 in 0.497s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:32 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d Sep 08 19:20:32 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:32 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8" returned: 0 in 0.407s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:32 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 1G Sep 08 19:20:32 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:33 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:33 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d Sep 08 19:20:33 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:33 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 1G" returned: 0 in 0.529s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85446d94-1fe8-4973-9efc-80580372ade8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:33 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f.62bf8cbc-d969-407e-acad-4c9909efd42d" returned: 0 in 0.345s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:33 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85446d94-1fe8-4973-9efc-80580372ade8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 Sep 08 19:20:33 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-62bf8cbc-d969-407e-acad-4c9909efd42d" released by "_delete_snapshot" :: held 1.944s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" released by "delete_snapshot" :: held 1.988s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Created reservations ['748936d2-25ca-494f-8c10-fd947565e8db', 'a9601e8b-2809-46fb-8729-a7ac162092dd', '61454ad2-cd14-4652-9a96-4bf478e8423b', '9c5c5d80-4932-4f72-97ad-fed9a70a7fa9'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:33 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a382d80f-70de-4d14-9682-7b1a2013dd6b tempest-ProjectMemberTests-823681440 None] Lock "cinder-62bf8cbc-d969-407e-acad-4c9909efd42d-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:33 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85446d94-1fe8-4973-9efc-80580372ade8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" returned: 0 in 0.433s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:33 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 is being set with open permissions: ugo+rw Sep 08 19:20:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:33 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 Sep 08 19:20:33 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:34 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" returned: 0 in 0.287s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:34 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.info Sep 08 19:20:34 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:34 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.info" returned: 0 in 0.290s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:34 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.info is being set with open permissions: ugo+rw Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:34 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:34 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:34 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.info Sep 08 19:20:34 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Lock "cinder-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:34 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.383s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732818f-cd59-4b2a-8ff6-6a0badd0cd82]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:34 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.info" returned: 0 in 0.502s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c659b5aa-b33f-4d7a-b03c-04e521fd0ba7 tempest-ProjectReaderTests-1015780814 None] Create snapshot completed successfully Sep 08 19:20:35 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f Sep 08 19:20:35 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:35 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" returned: 0 in 0.486s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:35 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f Sep 08 19:20:35 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:35 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" returned: 0 in 0.329s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f" released by "delete_volume" :: held 0.895s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Created reservations ['2269d575-d73f-48f9-afba-30f31f3e1dbf', 'c79ddb8e-7d88-427d-b7b4-4dc07645fd70', '19b7e110-68d9-47f1-83ab-93950d365d0f', '3cfb1828-7033-4816-854d-ce633f51dbcf'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:35 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:35 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:36 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.335s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:36 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-8db3e050-76f6-4b99-b3cc-b6b7d35c3da7-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-b44a86a5-a17e-4b4d-8c70-e369c4a63838 tempest-ProjectMemberTests-823681440 None] Lock "cinder-74c4b93c-ac5e-42cd-82e8-139c1b5f9a4f-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-8db3e050-76f6-4b99-b3cc-b6b7d35c3da7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-85446d94-1fe8-4973-9efc-80580372ade8" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-85446d94-1fe8-4973-9efc-80580372ade8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Deleting offline snapshot 8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 of volume 85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] snapshot_file for this snap is: volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7870e48c-5361-44bf-ae00-ec2d8b2da08d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:36 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 Sep 08 19:20:36 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (04716d63-e609-450d-b1e9-6738c3e9d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d4aed6-67a0-464e-b67a-20a3c4f5fa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26d4aed6-67a0-464e-b67a-20a3c4f5fa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449769505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7b3af8-530a-4fce-b8b5-12038be62dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:37Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd5a16a-0e40-4379-a0f7-87a9cc353ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd5a16a-0e40-4379-a0f7-87a9cc353ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb1733b-4399-4624-a838-5a2f05467324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb1733b-4399-4624-a838-5a2f05467324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7b3af8-530a-4fce-b8b5-12038be62dc8', 'volume_name': 'volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b26432-6b56-48c8-8b05-e3253901fe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b26432-6b56-48c8-8b05-e3253901fe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a300ce-d0e8-4f5a-b637-fd3e7cc263a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:36 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Volume 2a7b3af8-530a-4fce-b8b5-12038be62dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8', 'volume_size': 1} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449769505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7b3af8-530a-4fce-b8b5-12038be62dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:37Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Creating volume 2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:36 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:36 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 1073741824 Sep 08 19:20:36 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:37 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" returned: 0 in 0.593s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85446d94-1fe8-4973-9efc-80580372ade8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc12c53-735b-4a29-9306-c906c53c1b56]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:37 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 Sep 08 19:20:37 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:37 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 1073741824" returned: 0 in 0.677s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:37 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8" returned: 0 in 0.477s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:37 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 Sep 08 19:20:37 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:37 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 Sep 08 19:20:37 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:37 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8" returned: 0 in 0.295s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a300ce-d0e8-4f5a-b637-fd3e7cc263a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9a4730-5a8e-4494-8c6f-75278ef89541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:37 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Volume volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 (2a7b3af8-530a-4fce-b8b5-12038be62dc8): created successfully Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9a4730-5a8e-4494-8c6f-75278ef89541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:37 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (04716d63-e609-450d-b1e9-6738c3e9d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e402e461-d29a-4b25-a650-5ac03fa1a946 tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:20:38 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" returned: 0 in 0.487s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:38 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7 Sep 08 19:20:38 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:38 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:38 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8.8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" returned: 0 in 0.315s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-8db3e050-76f6-4b99-b3cc-b6b7d35c3da7" released by "_delete_snapshot" :: held 2.033s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-85446d94-1fe8-4973-9efc-80580372ade8" released by "delete_snapshot" :: held 2.069s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:38 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Created reservations ['0b7031d4-2521-4492-950e-fafba7b5716d', '5007be32-d44b-4b45-b1b6-9c0c877395f9', '4ca98f46-1a5f-49b9-b26e-89eccf8b9d50', 'd69d9eda-6691-41b8-9489-8234ebf596cb'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:38 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Delete snapshot completed successfully. Sep 08 19:20:38 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-47772521-cf23-460b-82a5-b9c7d4e43df1 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-8db3e050-76f6-4b99-b3cc-b6b7d35c3da7-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Creating offline snapshot cae3fb7f-4800-46b1-8dd0-130913720e4a of volume 2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a6319a-7736-4d87-8dba-124fe035c284]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:39 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 Sep 08 19:20:39 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-85446d94-1fe8-4973-9efc-80580372ade8-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:39 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Lock "cinder-85446d94-1fe8-4973-9efc-80580372ade8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8" returned: 0 in 0.416s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:39 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a 1G Sep 08 19:20:39 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-85446d94-1fe8-4973-9efc-80580372ade8" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-85446d94-1fe8-4973-9efc-80580372ade8" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[15987a70-8c27-44bf-8668-400f4889d677]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:39 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:39 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 Sep 08 19:20:39 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a 1G" returned: 0 in 0.523s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a Sep 08 19:20:40 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8" returned: 0 in 0.455s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8 Sep 08 19:20:40 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a" returned: 0 in 0.362s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:40 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a is being set with open permissions: ugo+rw Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a Sep 08 19:20:40 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-85446d94-1fe8-4973-9efc-80580372ade8" returned: 0 in 0.419s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-85446d94-1fe8-4973-9efc-80580372ade8" released by "delete_volume" :: held 0.977s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (2f39224e-d357-4c86-9c5a-ffda5c568e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97d4241-64c7-4428-b5aa-cc7bfb973875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97d4241-64c7-4428-b5aa-cc7bfb973875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770967789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3162ac04-f839-4b52-ab72-7d6992e758fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:41Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca8b45c-9a51-4811-8725-5f1c9a26abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca8b45c-9a51-4811-8725-5f1c9a26abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cee53e-b85c-49ff-a81f-a47ffb694bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6cee53e-b85c-49ff-a81f-a47ffb694bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3162ac04-f839-4b52-ab72-7d6992e758fd', 'volume_name': 'volume-3162ac04-f839-4b52-ab72-7d6992e758fd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e027dc-b720-4e13-bd13-92040e0b0a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e027dc-b720-4e13-bd13-92040e0b0a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667e990c-4620-48f7-a79f-19dc78d3d88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:40 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Volume 3162ac04-f839-4b52-ab72-7d6992e758fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3162ac04-f839-4b52-ab72-7d6992e758fd', 'volume_size': 1} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Created reservations ['0114632c-42ab-4e11-ac85-00aeafbe3f3c', 'c1feaf3b-2808-436a-a137-4cf43846528c', 'b238963b-9d26-4213-9b73-0f13f0f3f3b4', '3da94c93-607b-45f9-81c9-582c37e37566'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:40 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a" returned: 0 in 0.362s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:40 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.info Sep 08 19:20:40 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:41 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.292s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Deleted volume successfully. Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-2d296095-34b7-4e5f-a6cf-5070afa54d3e tempest-ProjectReaderTests-1015780814 None] Lock "cinder-85446d94-1fe8-4973-9efc-80580372ade8-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:41 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.info" returned: 0 in 0.314s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.info is being set with open permissions: ugo+rw Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:41 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.info Sep 08 19:20:41 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:41 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.info" returned: 0 in 0.255s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-770967789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3162ac04-f839-4b52-ab72-7d6992e758fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:41Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Creating volume 3162ac04-f839-4b52-ab72-7d6992e758fd {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:41 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:41 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd 1073741824 Sep 08 19:20:41 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:41 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d1056a78-96ae-44a8-bbff-b0b2320b3a45 tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:20:41 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd 1073741824" returned: 0 in 0.429s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:41 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd Sep 08 19:20:41 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:42 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd" returned: 0 in 0.302s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667e990c-4620-48f7-a79f-19dc78d3d88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3162ac04-f839-4b52-ab72-7d6992e758fd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7654896-b3dd-4c97-bf14-2a31434e42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (c4ad8870-f939-44db-8322-cff4e5409e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291c7128-8dae-4599-855b-8a88a872e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:42 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Volume volume-3162ac04-f839-4b52-ab72-7d6992e758fd (3162ac04-f839-4b52-ab72-7d6992e758fd): created successfully Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7654896-b3dd-4c97-bf14-2a31434e42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (2f39224e-d357-4c86-9c5a-ffda5c568e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291c7128-8dae-4599-855b-8a88a872e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-683950381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55b365a-f762-41e6-ab85-8ccb0143c27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:42Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89cdffe6-4158-4295-abc1-ef87ea02b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89cdffe6-4158-4295-abc1-ef87ea02b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88cf9d3-dbc4-4390-8e83-5c502953395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88cf9d3-dbc4-4390-8e83-5c502953395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55b365a-f762-41e6-ab85-8ccb0143c27d', 'volume_name': 'volume-f55b365a-f762-41e6-ab85-8ccb0143c27d', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bce47e2-d259-41b9-a1cf-fbfeb0e3192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bce47e2-d259-41b9-a1cf-fbfeb0e3192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471f2470-71d2-4905-96e0-ad814360c9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:42 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Volume f55b365a-f762-41e6-ab85-8ccb0143c27d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55b365a-f762-41e6-ab85-8ccb0143c27d', 'volume_size': 1} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-683950381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55b365a-f762-41e6-ab85-8ccb0143c27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:42Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Creating volume f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:42 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-cae3fb7f-4800-46b1-8dd0-130913720e4a-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:42 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6ba8a421-f670-4cf7-983c-d9e32647cc58 tempest-ProjectReaderTests-77742499 None] Created volume successfully. Sep 08 19:20:42 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d 1073741824 Sep 08 19:20:42 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Lock "cinder-cae3fb7f-4800-46b1-8dd0-130913720e4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-2a7b3af8-530a-4fce-b8b5-12038be62dc8" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-2a7b3af8-530a-4fce-b8b5-12038be62dc8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-cae3fb7f-4800-46b1-8dd0-130913720e4a" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-cae3fb7f-4800-46b1-8dd0-130913720e4a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot cae3fb7f-4800-46b1-8dd0-130913720e4a of volume 2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[967643d9-4b56-4a0f-9439-c8dca658ff1a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:42 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a Sep 08 19:20:42 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-3162ac04-f839-4b52-ab72-7d6992e758fd-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Lock "cinder-3162ac04-f839-4b52-ab72-7d6992e758fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-quobyte-3162ac04-f839-4b52-ab72-7d6992e758fd" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-3162ac04-f839-4b52-ab72-7d6992e758fd" acquired by "delete_volume" :: waited 0.027s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0c594-fd1a-4e82-867a-78b109fe5ee4]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:42 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a" returned: 0 in 0.503s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:43 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd Sep 08 19:20:43 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d 1073741824" returned: 0 in 0.693s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9933825-8618-44e6-b434-5055f66108a3]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d Sep 08 19:20:43 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:43 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 Sep 08 19:20:43 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:43 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd" returned: 0 in 0.494s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd Sep 08 19:20:43 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:43 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471f2470-71d2-4905-96e0-ad814360c9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55b365a-f762-41e6-ab85-8ccb0143c27d', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004de763-7bc5-405c-89be-fade57b18c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:43 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Volume volume-f55b365a-f762-41e6-ab85-8ccb0143c27d (f55b365a-f762-41e6-ab85-8ccb0143c27d): created successfully Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004de763-7bc5-405c-89be-fade57b18c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (c4ad8870-f939-44db-8322-cff4e5409e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:43 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f15b1057-5e99-4230-9d6d-15777931a1c1 tempest-ProjectReaderTests-1015780814 None] Created volume successfully. Sep 08 19:20:43 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8" returned: 0 in 0.485s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a Sep 08 19:20:43 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:43 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-3162ac04-f839-4b52-ab72-7d6992e758fd" returned: 0 in 0.276s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-3162ac04-f839-4b52-ab72-7d6992e758fd" released by "delete_volume" :: held 0.820s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Created reservations ['07ca7bd2-6dcd-4e07-bff3-aa27a3e79648', '5d44322c-e994-4d09-b199-b7b09fa4dc64', '5efee63c-3b71-4c6b-8638-d1529c840c62', '1f9c6578-3fe6-4d47-97c5-1894da10bad0'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:43 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:43 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:44 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a" returned: 0 in 0.376s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:44 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a Sep 08 19:20:44 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:44 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Deleted volume successfully. Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-011c639a-91f2-4734-a50f-da065582ae43 tempest-ProjectReaderTests-77742499 None] Lock "cinder-3162ac04-f839-4b52-ab72-7d6992e758fd-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:44 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8.cae3fb7f-4800-46b1-8dd0-130913720e4a" returned: 0 in 0.311s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-cae3fb7f-4800-46b1-8dd0-130913720e4a" released by "_delete_snapshot" :: held 1.838s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-2a7b3af8-530a-4fce-b8b5-12038be62dc8" released by "delete_snapshot" :: held 1.876s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Created reservations ['463f905a-6c29-4049-b5ce-cc7610666f20', '1ea399fb-9b53-49f0-8b85-df1cb4ef3e72', 'a53ebe3c-78b4-4900-9c6e-6d980251d7c3', '87981715-0203-4611-849e-df7a390da436'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:44 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-46296548-09c4-499e-8f17-711d92df597d tempest-ProjectMemberTests-823681440 None] Lock "cinder-cae3fb7f-4800-46b1-8dd0-130913720e4a-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-2a7b3af8-530a-4fce-b8b5-12038be62dc8-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (de7b106e-54a7-4dae-8d10-c5bff83327f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c438332-a5b2-4855-beba-5937c6163ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Lock "cinder-2a7b3af8-530a-4fce-b8b5-12038be62dc8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c438332-a5b2-4855-beba-5937c6163ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066933675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b760cc88-a63e-479c-83bd-156b3741cb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:45Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ef9a00-37e3-4ec5-a5e2-8358b595236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ef9a00-37e3-4ec5-a5e2-8358b595236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107b8f9b-37f7-47a5-b367-31891dc36ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107b8f9b-37f7-47a5-b367-31891dc36ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b760cc88-a63e-479c-83bd-156b3741cb56', 'volume_name': 'volume-b760cc88-a63e-479c-83bd-156b3741cb56', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e96020-c382-4cd5-b55a-8ada44f4806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e96020-c382-4cd5-b55a-8ada44f4806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6707e6-eaec-4b58-8397-262fbdf567d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:44 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Volume b760cc88-a63e-479c-83bd-156b3741cb56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b760cc88-a63e-479c-83bd-156b3741cb56', 'volume_size': 1} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066933675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b760cc88-a63e-479c-83bd-156b3741cb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:45Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Creating volume b760cc88-a63e-479c-83bd-156b3741cb56 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:44 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:44 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 1073741824 Sep 08 19:20:44 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-2a7b3af8-530a-4fce-b8b5-12038be62dc8" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-2a7b3af8-530a-4fce-b8b5-12038be62dc8" acquired by "delete_volume" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d045523-1906-4311-8565-75a467ada8a3]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:44 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:45 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 Sep 08 19:20:45 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:45 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 1073741824" returned: 0 in 0.506s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:45 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:45 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8 Sep 08 19:20:45 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:45 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 Sep 08 19:20:45 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:45 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:45 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2a7b3af8-530a-4fce-b8b5-12038be62dc8" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56" returned: 0 in 0.311s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-2a7b3af8-530a-4fce-b8b5-12038be62dc8" released by "delete_volume" :: held 0.808s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.840s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6707e6-eaec-4b58-8397-262fbdf567d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b760cc88-a63e-479c-83bd-156b3741cb56', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fefc184-22e5-4828-9a01-98e9c0595400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Creating offline snapshot 0ccfa0c7-5012-4085-aecb-7ab90c3459c9 of volume f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:45 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Volume volume-b760cc88-a63e-479c-83bd-156b3741cb56 (b760cc88-a63e-479c-83bd-156b3741cb56): created successfully Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fefc184-22e5-4828-9a01-98e9c0595400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (de7b106e-54a7-4dae-8d10-c5bff83327f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90a653-314a-4d55-9bbb-326ae08c7a69]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:45 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-9f8a6ce4-9ccd-44f3-bb38-4f92c1223e44 tempest-ProjectReaderTests-77742499 None] Created volume successfully. Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Created reservations ['f5fb44dc-a15b-49e4-b5d7-d7e68653dcd9', 'ba58b7db-fb8a-4ac7-a00e-bb5a3d36d78f', '09246da8-bf8b-442f-b804-1ac60066c7d4', 'a684c60d-b42e-403f-8564-1accd9fed899'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:45 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d Sep 08 19:20:45 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:45 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:46 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:46 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:46 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:46 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:46 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 1G Sep 08 19:20:46 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.277s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:46 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-5fec8c00-c77e-4310-b9c7-1fcd7af7f23b tempest-ProjectMemberTests-823681440 None] Lock "cinder-2a7b3af8-530a-4fce-b8b5-12038be62dc8-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:46 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 1G" returned: 0 in 0.466s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55b365a-f762-41e6-ab85-8ccb0143c27d -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:46 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55b365a-f762-41e6-ab85-8ccb0143c27d -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 Sep 08 19:20:46 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-b760cc88-a63e-479c-83bd-156b3741cb56-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:46 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Lock "cinder-b760cc88-a63e-479c-83bd-156b3741cb56-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-quobyte-b760cc88-a63e-479c-83bd-156b3741cb56" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-b760cc88-a63e-479c-83bd-156b3741cb56" acquired by "delete_volume" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d60e925-9a04-4a7d-b787-632023a1ed6a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:47 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55b365a-f762-41e6-ab85-8ccb0143c27d -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9" returned: 0 in 0.395s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:47 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 is being set with open permissions: ugo+rw Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:47 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 Sep 08 19:20:47 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:47 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 Sep 08 19:20:47 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:47 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9" returned: 0 in 0.321s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:47 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.info Sep 08 19:20:47 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:47 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56" returned: 0 in 0.465s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:47 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56 Sep 08 19:20:47 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (7f436786-a764-441d-9e76-8ddbee083979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c38bb3-9d97-43d0-aaaf-a2341cc28dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c38bb3-9d97-43d0-aaaf-a2341cc28dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244975867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea84ebc-84f5-49b0-bac4-7b57628afec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:48Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ce7d9a-bea3-457c-ad6d-75e016882855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ce7d9a-bea3-457c-ad6d-75e016882855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f73473-7857-4927-9bfc-ad05bb0be7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f73473-7857-4927-9bfc-ad05bb0be7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea84ebc-84f5-49b0-bac4-7b57628afec4', 'volume_name': 'volume-aea84ebc-84f5-49b0-bac4-7b57628afec4', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bd2896-81cf-41e2-a8a7-428136a92d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bd2896-81cf-41e2-a8a7-428136a92d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8f8633-107e-42fd-8966-3271243524b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:47 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Volume aea84ebc-84f5-49b0-bac4-7b57628afec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea84ebc-84f5-49b0-bac4-7b57628afec4', 'volume_size': 1} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:47 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.info" returned: 0 in 0.312s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:47 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.info is being set with open permissions: ugo+rw Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:47 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.info Sep 08 19:20:47 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:47 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-b760cc88-a63e-479c-83bd-156b3741cb56" returned: 0 in 0.307s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-b760cc88-a63e-479c-83bd-156b3741cb56" released by "delete_volume" :: held 0.826s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Created reservations ['b15f2ede-f678-425f-825d-3bc5114631d4', 'edddc55d-1b85-403d-ba0e-d06484e33720', '1b5c1d45-cf4e-4098-80c9-986511b33d56', 'aa9bd924-d83e-449f-8f5c-0c4c2db320ed'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:47 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:48 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:48 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:48 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.info" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.357s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244975867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea84ebc-84f5-49b0-bac4-7b57628afec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:48Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Creating volume aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:48 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:48 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 1073741824 Sep 08 19:20:48 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-83aaa9a8-6df6-4cca-9e5b-543e5e4d81cc tempest-ProjectReaderTests-1015780814 None] Create snapshot completed successfully Sep 08 19:20:48 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.334s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:48 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Deleted volume successfully. Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3831a35f-6bc1-486b-a6b9-dccab0858b11 tempest-ProjectReaderTests-77742499 None] Lock "cinder-b760cc88-a63e-479c-83bd-156b3741cb56-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:48 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 1073741824" returned: 0 in 0.564s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:48 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 Sep 08 19:20:48 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (6baaa91a-02ef-42d4-8bdf-b6ad736c09e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a06f1bd-4d51-485a-85f2-c2f591c7ca62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a06f1bd-4d51-485a-85f2-c2f591c7ca62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335586311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08153839-c8df-4569-9564-002333a48905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:49Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d740a326-fb26-43c6-bbc4-d8c6b1c284d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d740a326-fb26-43c6-bbc4-d8c6b1c284d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e04e3f-e79a-482f-b3d7-ebdc075817e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e04e3f-e79a-482f-b3d7-ebdc075817e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08153839-c8df-4569-9564-002333a48905', 'volume_name': 'volume-08153839-c8df-4569-9564-002333a48905', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d0564f-c607-45f7-b3ca-25b261a6b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d0564f-c607-45f7-b3ca-25b261a6b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d888468e-2c6b-43e8-9b23-0ff07dbe051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:48 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Volume 08153839-c8df-4569-9564-002333a48905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08153839-c8df-4569-9564-002333a48905', 'volume_size': 1} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-0ccfa0c7-5012-4085-aecb-7ab90c3459c9-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Lock "cinder-0ccfa0c7-5012-4085-aecb-7ab90c3459c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-f55b365a-f762-41e6-ab85-8ccb0143c27d" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f55b365a-f762-41e6-ab85-8ccb0143c27d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-0ccfa0c7-5012-4085-aecb-7ab90c3459c9" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-0ccfa0c7-5012-4085-aecb-7ab90c3459c9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:48 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Deleting offline snapshot 0ccfa0c7-5012-4085-aecb-7ab90c3459c9 of volume f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] snapshot_file for this snap is: volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f92f74-f3c3-48bf-b57c-7046b3a75345]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:49 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4" returned: 0 in 0.357s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.178s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-335586311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08153839-c8df-4569-9564-002333a48905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:49Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Creating volume 08153839-c8df-4569-9564-002333a48905 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:49 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8f8633-107e-42fd-8966-3271243524b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea84ebc-84f5-49b0-bac4-7b57628afec4', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad590a04-9e76-4974-900f-225952834b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:49 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 1073741824 Sep 08 19:20:49 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Volume volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 (aea84ebc-84f5-49b0-bac4-7b57628afec4): created successfully Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad590a04-9e76-4974-900f-225952834b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:49 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (7f436786-a764-441d-9e76-8ddbee083979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:49 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7450b979-5264-4827-a4dc-4376a86a9659 tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:20:49 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9" returned: 0 in 0.432s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55b365a-f762-41e6-ab85-8ccb0143c27d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6539ec-f2b5-4835-af58-30639b6b8509]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:49 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 1073741824" returned: 0 in 0.520s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:49 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d Sep 08 19:20:49 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:49 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 Sep 08 19:20:49 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:49 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905" returned: 0 in 0.267s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d888468e-2c6b-43e8-9b23-0ff07dbe051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08153839-c8df-4569-9564-002333a48905', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b589523-3cca-43e0-9e5a-15304f4cd1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:49 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Volume volume-08153839-c8df-4569-9564-002333a48905 (08153839-c8df-4569-9564-002333a48905): created successfully Sep 08 19:20:49 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b589523-3cca-43e0-9e5a-15304f4cd1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (6baaa91a-02ef-42d4-8bdf-b6ad736c09e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d" returned: 0 in 0.472s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:49 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:49 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 Sep 08 19:20:49 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:49 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-845bec77-4ab8-4709-99cb-2f2ef0390fd2 tempest-ProjectReaderTests-77742499 None] Created volume successfully. Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Creating offline snapshot c53d779c-0d4b-404d-a317-88895bd7dd49 of volume aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c8fd3f-b374-440c-ae9c-0f65a56db714]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:50 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 Sep 08 19:20:50 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:50 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9" returned: 0 in 0.353s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:50 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9 Sep 08 19:20:50 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:50 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4" returned: 0 in 0.390s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:50 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 1G Sep 08 19:20:50 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:50 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d.0ccfa0c7-5012-4085-aecb-7ab90c3459c9" returned: 0 in 0.304s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-0ccfa0c7-5012-4085-aecb-7ab90c3459c9" released by "_delete_snapshot" :: held 1.668s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f55b365a-f762-41e6-ab85-8ccb0143c27d" released by "delete_snapshot" :: held 1.704s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Created reservations ['8f9437f1-e766-42e1-bfdb-fa3b0173d36e', '8f4dc1ef-41ff-4296-bbce-6e985ab8f81e', '7d7177bc-cd2b-4adb-b456-2dd042536a1a', 'b4b0b470-5bea-485b-88bb-31c669bee189'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:50 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Delete snapshot completed successfully. Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-48cd69e9-47dc-42c3-9655-60efbddcf91b tempest-ProjectReaderTests-1015780814 None] Lock "cinder-0ccfa0c7-5012-4085-aecb-7ab90c3459c9-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:50 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 1G" returned: 0 in 0.528s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:50 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-08153839-c8df-4569-9564-002333a48905-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:50 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 Sep 08 19:20:50 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Lock "cinder-08153839-c8df-4569-9564-002333a48905-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-quobyte-08153839-c8df-4569-9564-002333a48905" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-08153839-c8df-4569-9564-002333a48905" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[7039e90a-50cc-4053-a5c0-3fa6d7f8f0e1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-f55b365a-f762-41e6-ab85-8ccb0143c27d-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-f55b365a-f762-41e6-ab85-8ccb0143c27d-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:51 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 Sep 08 19:20:51 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-f55b365a-f762-41e6-ab85-8ccb0143c27d" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:51 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49" returned: 0 in 0.430s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:51 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 is being set with open permissions: ugo+rw Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f55b365a-f762-41e6-ab85-8ccb0143c27d" acquired by "delete_volume" :: waited 0.036s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:51 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 Sep 08 19:20:51 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2625ef93-c0c4-42a9-a918-99ad0edecb02]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:51 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d Sep 08 19:20:51 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:51 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905" returned: 0 in 0.509s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:51 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905 Sep 08 19:20:51 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:51 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49" returned: 0 in 0.290s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:51 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.info Sep 08 19:20:51 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:51 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d" returned: 0 in 0.411s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:51 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d Sep 08 19:20:51 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:51 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-08153839-c8df-4569-9564-002333a48905" returned: 0 in 0.278s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-08153839-c8df-4569-9564-002333a48905" released by "delete_volume" :: held 0.843s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:51 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.info" returned: 0 in 0.269s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:51 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.info is being set with open permissions: ugo+rw Sep 08 19:20:51 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:51 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.info Sep 08 19:20:51 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Created reservations ['02781084-9dc5-4956-ab58-05b2c60832e2', '8fd378a5-b9ab-4cb6-ac7e-2526cda76c0e', '3826aa78-d0ef-4f17-8857-683ba7dbe7cc', '173a94f4-bc19-4e09-99ea-86974c2865f4'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:52 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:52 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:52 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f55b365a-f762-41e6-ab85-8ccb0143c27d" returned: 0 in 0.309s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f55b365a-f762-41e6-ab85-8ccb0143c27d" released by "delete_volume" :: held 0.799s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Created reservations ['80bdcacf-700f-4514-8dd4-60b6ec4f9446', 'b1d4ff77-7efa-47dc-aa81-e2a5070b03a1', '369fde7f-0230-4927-a4f5-267b508dc34b', 'b54fac84-0275-4be3-b319-71f2244216d7'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:52 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.info" returned: 0 in 0.332s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.344s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8faa1257-556b-4c78-8b8a-cdeb4e388838 tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:52 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:52 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:52 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.355s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Deleted volume successfully. Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d0d24042-b798-4a49-abb8-f9eb01abc2cc tempest-ProjectReaderTests-77742499 None] Lock "cinder-08153839-c8df-4569-9564-002333a48905-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:52 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.346s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:52 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Deleted volume successfully. Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0575535d-d99f-445b-967f-88848fdee014 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-f55b365a-f762-41e6-ab85-8ccb0143c27d-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (b6bd51f2-387c-43b9-bbb0-5ed2ad3a4322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396481b9-c021-4e70-8b10-209d5f1e2b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396481b9-c021-4e70-8b10-209d5f1e2b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449215265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab4beb1-a04f-4dea-a431-b12da43d96b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:53Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9c7bbb-4f1f-4700-af71-3ea0234390c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9c7bbb-4f1f-4700-af71-3ea0234390c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d93a68-aa72-493b-be51-bff049624f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d93a68-aa72-493b-be51-bff049624f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ab4beb1-a04f-4dea-a431-b12da43d96b5', 'volume_name': 'volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a91bcee-9da1-43b8-8036-b99446c0977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a91bcee-9da1-43b8-8036-b99446c0977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22116b83-ca8b-4b2d-a441-18e238f5ceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:52 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Volume 2ab4beb1-a04f-4dea-a431-b12da43d96b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5', 'volume_size': 1} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449215265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab4beb1-a04f-4dea-a431-b12da43d96b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bf5a07966e547bebcc0c1bbd9acb4d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:53Z,use_quota=True,user_id='466afd393da64a74ad845ce5f25d7631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Creating volume 2ab4beb1-a04f-4dea-a431-b12da43d96b5 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:52 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:52 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:53 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 1073741824 Sep 08 19:20:53 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (18ef7df0-16c6-43fd-af11-a55bbb15406b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b477058d-7bbe-4109-9e2d-cba5800d7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b477058d-7bbe-4109-9e2d-cba5800d7625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688262237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728fc38f-49c4-4657-829a-499f733d952a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:53Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84c9e26-2349-4322-bbd3-0a0f985a9e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84c9e26-2349-4322-bbd3-0a0f985a9e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc48e9a6-75bf-42bd-814c-d43d83888d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc48e9a6-75bf-42bd-814c-d43d83888d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728fc38f-49c4-4657-829a-499f733d952a', 'volume_name': 'volume-728fc38f-49c4-4657-829a-499f733d952a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d008a382-d31f-4d31-aa8f-e6d4d3fa43a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d008a382-d31f-4d31-aa8f-e6d4d3fa43a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a2c064-4470-4bae-ae41-3d3503145b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Volume 728fc38f-49c4-4657-829a-499f733d952a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728fc38f-49c4-4657-829a-499f733d952a', 'volume_size': 1} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-c53d779c-0d4b-404d-a317-88895bd7dd49-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Lock "cinder-c53d779c-0d4b-404d-a317-88895bd7dd49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-aea84ebc-84f5-49b0-bac4-7b57628afec4" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aea84ebc-84f5-49b0-bac4-7b57628afec4" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-c53d779c-0d4b-404d-a317-88895bd7dd49" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-c53d779c-0d4b-404d-a317-88895bd7dd49" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot c53d779c-0d4b-404d-a317-88895bd7dd49 of volume aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b2693-8f83-48b4-aa37-1c760240cdb3]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:53 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 Sep 08 19:20:53 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:53 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 1073741824" returned: 0 in 0.539s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:53 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 Sep 08 19:20:53 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:53 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:53 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49" returned: 0 in 0.453s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea84ebc-84f5-49b0-bac4-7b57628afec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5" returned: 0 in 0.304s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-688262237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728fc38f-49c4-4657-829a-499f733d952a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:53Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Creating volume 728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:53 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[33785838-64ef-4786-969e-7f10a37569c2]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:53 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a 1073741824 Sep 08 19:20:53 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22116b83-ca8b-4b2d-a441-18e238f5ceec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac166258-09ec-4729-b7b8-3aa659b90608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Volume volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 (2ab4beb1-a04f-4dea-a431-b12da43d96b5): created successfully Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac166258-09ec-4729-b7b8-3aa659b90608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Flow 'volume_create_manager' (b6bd51f2-387c-43b9-bbb0-5ed2ad3a4322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:53 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b956bcf6-ad4d-4f91-9caa-cb7da82c315e tempest-ProjectReaderTests-77742499 None] Created volume successfully. Sep 08 19:20:54 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 Sep 08 19:20:54 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:54 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4" returned: 0 in 0.455s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:54 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 Sep 08 19:20:54 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:54 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a 1073741824" returned: 0 in 0.574s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:54 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a Sep 08 19:20:54 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:54 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49" returned: 0 in 0.397s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:54 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a" returned: 0 in 0.294s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:54 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49 Sep 08 19:20:54 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a2c064-4470-4bae-ae41-3d3503145b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728fc38f-49c4-4657-829a-499f733d952a', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b6d696-7ff4-49f1-8fd7-a2697b05aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:54 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Volume volume-728fc38f-49c4-4657-829a-499f733d952a (728fc38f-49c4-4657-829a-499f733d952a): created successfully Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b6d696-7ff4-49f1-8fd7-a2697b05aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (18ef7df0-16c6-43fd-af11-a55bbb15406b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:54 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1edc815f-33ae-4911-ad2d-44ba372562cc tempest-ProjectReaderTests-1015780814 None] Created volume successfully. Sep 08 19:20:54 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-2ab4beb1-a04f-4dea-a431-b12da43d96b5-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Lock "cinder-2ab4beb1-a04f-4dea-a431-b12da43d96b5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:55 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Acquiring lock "cinder-quobyte-2ab4beb1-a04f-4dea-a431-b12da43d96b5" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4.c53d779c-0d4b-404d-a317-88895bd7dd49" returned: 0 in 0.345s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-c53d779c-0d4b-404d-a317-88895bd7dd49" released by "_delete_snapshot" :: held 1.802s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-2ab4beb1-a04f-4dea-a431-b12da43d96b5" acquired by "delete_volume" :: waited 0.069s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aea84ebc-84f5-49b0-bac4-7b57628afec4" released by "delete_snapshot" :: held 1.846s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7c737d-1a5a-41a8-8a92-afa0a3968718]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Created reservations ['47d6819f-5d2e-4c20-9634-2f327a1b7b30', '3d397078-93c0-45e1-8d94-31e257ad75dc', '07b49f5f-d1ce-4952-a3f4-b16201a72af0', '363db819-6043-46e8-81cf-4643a8feea5e'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:55 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-ccb5012b-5ef9-450d-94c8-4e69fab23fde tempest-ProjectMemberTests-823681440 None] Lock "cinder-c53d779c-0d4b-404d-a317-88895bd7dd49-delete_snapshot" released by "delete_snapshot" :: held 2.093s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:55 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 Sep 08 19:20:55 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Creating offline snapshot 4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 of volume 728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea281b0-4b27-4f9c-902c-71dd9ce82905]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-aea84ebc-84f5-49b0-bac4-7b57628afec4-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Lock "cinder-aea84ebc-84f5-49b0-bac4-7b57628afec4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-aea84ebc-84f5-49b0-bac4-7b57628afec4" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aea84ebc-84f5-49b0-bac4-7b57628afec4" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:55 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a Sep 08 19:20:55 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd9f618-94d8-4586-8c9b-9441950d44ef]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5" returned: 0 in 0.583s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 Sep 08 19:20:55 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:55 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5 Sep 08 19:20:55 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:55 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a" returned: 0 in 0.461s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:55 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 1G Sep 08 19:20:55 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-2ab4beb1-a04f-4dea-a431-b12da43d96b5" returned: 0 in 0.301s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Lock "cinder-quobyte-2ab4beb1-a04f-4dea-a431-b12da43d96b5" released by "delete_volume" :: held 0.944s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4" returned: 0 in 0.443s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:56 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4 Sep 08 19:20:56 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Created reservations ['161577c4-5b6e-4814-826b-bbb6c5fa0e73', 'd7c84743-e982-4c0f-8bf6-b68588a0452b', '18c717dc-2d62-4dc2-9e03-9451b7ce1f9e', '933db31b-aada-4a96-93e3-50e3b0226a10'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:56 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:56 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aea84ebc-84f5-49b0-bac4-7b57628afec4" returned: 0 in 0.322s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aea84ebc-84f5-49b0-bac4-7b57628afec4" released by "delete_volume" :: held 0.860s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:56 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 1G" returned: 0 in 0.538s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728fc38f-49c4-4657-829a-499f733d952a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:56 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728fc38f-49c4-4657-829a-499f733d952a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 Sep 08 19:20:56 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Created reservations ['fb63eb58-ecb3-4db8-b544-6d6c28aed9da', '213a5969-adb9-4822-ba1c-d388b2f7f141', '66ff4b24-6fdd-40ea-83f0-7dafeca3ee0a', '46a9cbba-13b4-4afb-bc62-c7bbd2639df2'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:56 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:20:56 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.438s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Deleted volume successfully. Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-27b46996-9f1d-4b79-9b2f-d753d4feff67 tempest-ProjectReaderTests-77742499 None] Lock "cinder-2ab4beb1-a04f-4dea-a431-b12da43d96b5-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:56 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-728fc38f-49c4-4657-829a-499f733d952a -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" returned: 0 in 0.426s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 is being set with open permissions: ugo+rw Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:56 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 Sep 08 19:20:56 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.334s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:56 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-d8bd9b71-bf06-4041-87f7-840b11580ddd tempest-ProjectMemberTests-823681440 None] Lock "cinder-aea84ebc-84f5-49b0-bac4-7b57628afec4-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:57 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:57 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.info Sep 08 19:20:57 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (87249a1b-0db1-45e9-97b3-39a448717d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584da2ff-7b86-4f75-8709-c6964d59b0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584da2ff-7b86-4f75-8709-c6964d59b0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771308149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa519dd6-aa7a-47e8-8a93-a06c516320ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:57Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409780a9-3fcb-47ee-ad8d-ddfd16bc9ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409780a9-3fcb-47ee-ad8d-ddfd16bc9ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8047a294-f6c6-4574-8e32-811421cc624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8047a294-f6c6-4574-8e32-811421cc624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa519dd6-aa7a-47e8-8a93-a06c516320ce', 'volume_name': 'volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b944d5-2994-490c-84b2-c6bafcd24f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b944d5-2994-490c-84b2-c6bafcd24f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d127497e-3d0f-423b-8e7a-95ba9ab259e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:57 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Volume aa519dd6-aa7a-47e8-8a93-a06c516320ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce', 'volume_size': 1} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:57 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.info" returned: 0 in 0.339s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:57 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.info is being set with open permissions: ugo+rw Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:57 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.info Sep 08 19:20:57 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:57 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.info" returned: 0 in 0.259s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771308149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa519dd6-aa7a-47e8-8a93-a06c516320ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:57Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Creating volume aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:57 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:20:57 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:57 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce 1073741824 Sep 08 19:20:57 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:57 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f8896bae-df1b-4b4b-aa3d-ff7db4e616f6 tempest-ProjectReaderTests-1015780814 None] Create snapshot completed successfully Sep 08 19:20:58 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce 1073741824" returned: 0 in 0.558s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:58 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce Sep 08 19:20:58 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Lock "cinder-4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-728fc38f-49c4-4657-829a-499f733d952a" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-728fc38f-49c4-4657-829a-499f733d952a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Deleting offline snapshot 4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 of volume 728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] snapshot_file for this snap is: volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb9410-3f9f-43db-9dd4-9a72158c8baf]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:58 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce" returned: 0 in 0.306s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d127497e-3d0f-423b-8e7a-95ba9ab259e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b65f81f-d117-4577-b4f3-58a4f44f3f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:58 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Volume volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce (aa519dd6-aa7a-47e8-8a93-a06c516320ce): created successfully Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b65f81f-d117-4577-b4f3-58a4f44f3f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:58 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (87249a1b-0db1-45e9-97b3-39a448717d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:58 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a20b7b56-358e-4847-a508-59d31a9afd08 tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:20:58 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 Sep 08 19:20:58 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:59 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" returned: 0 in 0.421s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-728fc38f-49c4-4657-829a-499f733d952a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af199fc-2c5e-4c19-8d06-ed0e3a4525a9]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:59 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a Sep 08 19:20:59 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Creating offline snapshot 2cc31aad-59ed-473a-b10c-de7daf5d48d1 of volume aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[28840293-b546-4a4b-aea3-646da82512ec]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:59 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a" returned: 0 in 0.501s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:59 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:59 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 Sep 08 19:20:59 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:59 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce Sep 08 19:20:59 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:00 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" returned: 0 in 0.369s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:00 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:00 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9 Sep 08 19:21:00 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:00 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 1G Sep 08 19:21:00 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:00 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a.4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" returned: 0 in 0.260s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9" released by "_delete_snapshot" :: held 1.672s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-728fc38f-49c4-4657-829a-499f733d952a" released by "delete_snapshot" :: held 1.705s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Created reservations ['dcce26af-a208-4543-af68-82969887506c', '5c054579-07f6-442b-b1b2-b1d9bf19164d', 'afa75886-0719-4fed-a4c0-df2ed32ac8af', '6760bf08-1cd0-48af-8f49-ea8c60437a0d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:00 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Delete snapshot completed successfully. Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a8021519-71ac-48b6-90d6-55c564d5eeac tempest-ProjectReaderTests-1015780814 None] Lock "cinder-4b5e9fc8-7dfb-4d47-a370-ebe1ec86c0c9-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:00 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 1G" returned: 0 in 0.495s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:00 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 Sep 08 19:21:00 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-728fc38f-49c4-4657-829a-499f733d952a-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-728fc38f-49c4-4657-829a-499f733d952a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-728fc38f-49c4-4657-829a-499f733d952a" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:00 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-728fc38f-49c4-4657-829a-499f733d952a" acquired by "delete_volume" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34a916-9308-44b0-bd3a-396570d0795b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:01 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:01 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 is being set with open permissions: ugo+rw Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:01 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 Sep 08 19:21:01 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:01 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a Sep 08 19:21:01 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:01 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:01 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.info Sep 08 19:21:01 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:01 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a" returned: 0 in 0.401s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:01 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a Sep 08 19:21:01 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:01 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.info" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:01 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.info is being set with open permissions: ugo+rw Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:01 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.info Sep 08 19:21:01 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:01 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-728fc38f-49c4-4657-829a-499f733d952a" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-728fc38f-49c4-4657-829a-499f733d952a" released by "delete_volume" :: held 0.746s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Created reservations ['5ac6582a-76b1-4a23-9aa8-37dc22179b2b', 'afe7050c-23e1-4727-a070-a01e28bc95cd', '2005b174-d549-4f3b-9777-5d7bdfee2176', '7f7085e4-7742-4fb6-987d-15bd420f5049'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:01 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:01 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:01 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:01 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.info" returned: 0 in 0.316s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-35fd5e23-9b20-4052-b962-54827ad1d30a tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:21:02 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.442s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:02 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Deleted volume successfully. Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-280505bb-7607-49df-9b5e-2af4d48f3f37 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-728fc38f-49c4-4657-829a-499f733d952a-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (30bd3736-4a44-467a-893f-a29bfed8a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286738d2-d914-4cbf-94b0-f7dee195b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-2cc31aad-59ed-473a-b10c-de7daf5d48d1-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286738d2-d914-4cbf-94b0-f7dee195b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013931780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27de0d2-0992-4a7a-b82c-8dfbb801faad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:03Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e4083-bf9b-4bd4-aa05-7243023f9509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e4083-bf9b-4bd4-aa05-7243023f9509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:02 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec101619-e56a-4232-b474-ea25610eb7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec101619-e56a-4232-b474-ea25610eb7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27de0d2-0992-4a7a-b82c-8dfbb801faad', 'volume_name': 'volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41e9761-6bb9-43ea-aa54-0bb28f5950a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41e9761-6bb9-43ea-aa54-0bb28f5950a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a80722f-9b65-49c9-b159-60b746c5cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:03 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Volume f27de0d2-0992-4a7a-b82c-8dfbb801faad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad', 'volume_size': 1} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2013931780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27de0d2-0992-4a7a-b82c-8dfbb801faad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:03Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Creating volume f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:03 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Lock "cinder-2cc31aad-59ed-473a-b10c-de7daf5d48d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.102s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-aa519dd6-aa7a-47e8-8a93-a06c516320ce" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:03 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad 1073741824 Sep 08 19:21:03 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aa519dd6-aa7a-47e8-8a93-a06c516320ce" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-2cc31aad-59ed-473a-b10c-de7daf5d48d1" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-2cc31aad-59ed-473a-b10c-de7daf5d48d1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot 2cc31aad-59ed-473a-b10c-de7daf5d48d1 of volume aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e46e1d7-a25a-45a9-b158-351ae76651fe]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 Sep 08 19:21:03 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:03 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad 1073741824" returned: 0 in 0.598s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:03 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1" returned: 0 in 0.493s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9313e2-2cc7-43bd-9c8f-8f805351636d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:03 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad Sep 08 19:21:03 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:03 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce Sep 08 19:21:03 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:04 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad" returned: 0 in 0.331s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a80722f-9b65-49c9-b159-60b746c5cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f44ec70-8111-43b2-9c9e-e0eb0ac5e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:04 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Volume volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad (f27de0d2-0992-4a7a-b82c-8dfbb801faad): created successfully Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f44ec70-8111-43b2-9c9e-e0eb0ac5e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (30bd3736-4a44-467a-893f-a29bfed8a55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:04 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d3a53272-380c-4cc3-950e-ef4157c6534e tempest-ProjectReaderTests-1015780814 None] Created volume successfully. Sep 08 19:21:04 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce" returned: 0 in 0.549s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:04 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 Sep 08 19:21:04 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:04 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1" returned: 0 in 0.433s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:04 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1 Sep 08 19:21:04 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:04 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:04 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce.2cc31aad-59ed-473a-b10c-de7daf5d48d1" returned: 0 in 0.295s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-2cc31aad-59ed-473a-b10c-de7daf5d48d1" released by "_delete_snapshot" :: held 1.930s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aa519dd6-aa7a-47e8-8a93-a06c516320ce" released by "delete_snapshot" :: held 1.976s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Created reservations ['cc848659-ecde-443b-8fae-4f20a981b5c3', '541c4be0-35aa-48b5-b865-243de8911c38', '88596d17-e937-496d-bd31-dfbc89358c37', '04ef70e2-e9c6-4dd7-b634-ffffd78732cd'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:05 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-a13803c9-b1d0-426d-b333-4bdce0774813 tempest-ProjectMemberTests-823681440 None] Lock "cinder-2cc31aad-59ed-473a-b10c-de7daf5d48d1-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Creating offline snapshot 18bc9e8a-35de-4eca-a8db-b41417e66f08 of volume f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67edb07-8337-4a9a-aea0-4e91aaa2f99b]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:05 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad Sep 08 19:21:05 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:05 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad" returned: 0 in 0.410s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:05 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:05 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 1G Sep 08 19:21:05 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:06 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 1G" returned: 0 in 0.512s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-aa519dd6-aa7a-47e8-8a93-a06c516320ce-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:06 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 Sep 08 19:21:06 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Lock "cinder-aa519dd6-aa7a-47e8-8a93-a06c516320ce-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-aa519dd6-aa7a-47e8-8a93-a06c516320ce" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aa519dd6-aa7a-47e8-8a93-a06c516320ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d620e5-7116-46a8-85c1-ddb5ecdb483a]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:06 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce Sep 08 19:21:06 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:06 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08" returned: 0 in 0.420s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:06 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 is being set with open permissions: ugo+rw Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:06 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 Sep 08 19:21:06 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:06 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce" returned: 0 in 0.425s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:06 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce Sep 08 19:21:06 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:06 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:06 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08" returned: 0 in 0.306s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:07 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.info Sep 08 19:21:07 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:07 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-aa519dd6-aa7a-47e8-8a93-a06c516320ce" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-aa519dd6-aa7a-47e8-8a93-a06c516320ce" released by "delete_volume" :: held 0.819s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:07 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.info" returned: 0 in 0.253s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.info is being set with open permissions: ugo+rw Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:07 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.info Sep 08 19:21:07 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Created reservations ['dd50b92e-287b-42b8-858e-454fbb8f5029', 'f60abc11-23e2-4e05-a734-692212e207f9', 'e96e4bc7-4dfd-451a-8e28-c78ece4793a5', 'c6bc71df-2a81-45a6-bc07-208aca2406ed'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:07 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:07 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:07 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.info" returned: 0 in 0.274s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-38786eef-500c-4f14-93f3-c91e88b24ef7 tempest-ProjectReaderTests-1015780814 None] Create snapshot completed successfully Sep 08 19:21:07 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.300s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:07 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:21:07 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-20da0fd1-b091-427b-b5f8-e5f8e72161c7 tempest-ProjectMemberTests-823681440 None] Lock "cinder-aa519dd6-aa7a-47e8-8a93-a06c516320ce-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (c781efc0-5c71-4e92-80e5-5670701f1bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831dba30-8fcb-4830-8e43-6b88653fab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831dba30-8fcb-4830-8e43-6b88653fab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161733156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192e3d9e-854b-41be-aa4a-26779cedf678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:08Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5969cf2-7ad7-4db9-ba55-f417703971d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5969cf2-7ad7-4db9-ba55-f417703971d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033e2c33-b615-4c20-a145-3bf00b476772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033e2c33-b615-4c20-a145-3bf00b476772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192e3d9e-854b-41be-aa4a-26779cedf678', 'volume_name': 'volume-192e3d9e-854b-41be-aa4a-26779cedf678', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7c1a98-bce9-4fd4-9fda-5725b8b5866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7c1a98-bce9-4fd4-9fda-5725b8b5866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bcc358-e339-4b74-9458-7fe4caa6e74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Volume 192e3d9e-854b-41be-aa4a-26779cedf678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192e3d9e-854b-41be-aa4a-26779cedf678', 'volume_size': 1} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-161733156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192e3d9e-854b-41be-aa4a-26779cedf678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b45dca1fd46d4aad77ff620b60e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:08Z,use_quota=True,user_id='95632cb9fdbb4030b1a7feea0e6d6155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Creating volume 192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:08 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 1073741824 Sep 08 19:21:08 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-18bc9e8a-35de-4eca-a8db-b41417e66f08-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-18bc9e8a-35de-4eca-a8db-b41417e66f08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-f27de0d2-0992-4a7a-b82c-8dfbb801faad" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f27de0d2-0992-4a7a-b82c-8dfbb801faad" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-18bc9e8a-35de-4eca-a8db-b41417e66f08" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:08 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 1073741824" returned: 0 in 0.540s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-18bc9e8a-35de-4eca-a8db-b41417e66f08" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Deleting offline snapshot 18bc9e8a-35de-4eca-a8db-b41417e66f08 of volume f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] snapshot_file for this snap is: volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ad03b3-629d-4b2e-a29d-255919cd25d6]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 Sep 08 19:21:08 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 Sep 08 19:21:08 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:09 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678" returned: 0 in 0.265s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bcc358-e339-4b74-9458-7fe4caa6e74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192e3d9e-854b-41be-aa4a-26779cedf678', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbae2215-a3e5-4e0a-8409-b76280e52e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:09 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Volume volume-192e3d9e-854b-41be-aa4a-26779cedf678 (192e3d9e-854b-41be-aa4a-26779cedf678): created successfully Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbae2215-a3e5-4e0a-8409-b76280e52e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Flow 'volume_create_manager' (c781efc0-5c71-4e92-80e5-5670701f1bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:09 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c73ab440-bf03-4274-a795-15c9078c22c3 tempest-ProjectMemberTests-823681440 None] Created volume successfully. Sep 08 19:21:09 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08" returned: 0 in 0.424s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e2800b-6eb2-4036-8f46-48e1eec7a504]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:09 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad Sep 08 19:21:09 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:09 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad" returned: 0 in 0.378s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:09 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 Sep 08 19:21:09 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:09 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08" returned: 0 in 0.353s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:09 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08 Sep 08 19:21:09 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:10 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad.18bc9e8a-35de-4eca-a8db-b41417e66f08" returned: 0 in 0.275s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-18bc9e8a-35de-4eca-a8db-b41417e66f08" released by "_delete_snapshot" :: held 1.540s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f27de0d2-0992-4a7a-b82c-8dfbb801faad" released by "delete_snapshot" :: held 1.581s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Created reservations ['83a10993-cdf4-4b0e-affb-b144b845972d', 'dbad743a-b1a8-406e-b445-cf19a94166c4', 'ad5f96bd-4ffe-4c3f-a2b5-89b76f91b2ee', '27c9aa85-e720-483b-9265-b4e6e6373f9a'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Creating offline snapshot 346592c6-80f2-42ce-b14f-a38536e024de of volume 192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e423ff-4076-4388-bb79-4e07eea6da4f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Delete snapshot completed successfully. Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ac0e290-5231-4e00-a795-b9aee9594972 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-18bc9e8a-35de-4eca-a8db-b41417e66f08-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:10 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 Sep 08 19:21:10 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-f27de0d2-0992-4a7a-b82c-8dfbb801faad-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Lock "cinder-f27de0d2-0992-4a7a-b82c-8dfbb801faad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:10 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678" returned: 0 in 0.413s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:10 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de 1G Sep 08 19:21:10 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-f27de0d2-0992-4a7a-b82c-8dfbb801faad" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f27de0d2-0992-4a7a-b82c-8dfbb801faad" acquired by "delete_volume" :: waited 0.020s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd5f75b-3fae-437b-9d79-96e7e04f053f]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:10 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad Sep 08 19:21:11 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de 1G" returned: 0 in 0.484s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192e3d9e-854b-41be-aa4a-26779cedf678 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192e3d9e-854b-41be-aa4a-26779cedf678 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de Sep 08 19:21:11 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad" returned: 0 in 0.467s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad Sep 08 19:21:11 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-192e3d9e-854b-41be-aa4a-26779cedf678 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de" returned: 0 in 0.330s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:11 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de is being set with open permissions: ugo+rw Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de Sep 08 19:21:11 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-f27de0d2-0992-4a7a-b82c-8dfbb801faad" returned: 0 in 0.289s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-f27de0d2-0992-4a7a-b82c-8dfbb801faad" released by "delete_volume" :: held 0.824s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Created reservations ['bad9b9bf-e396-493d-bdbb-5c6f13ad6f06', '492712d1-292e-4089-881a-7236bf14404b', '75730ffa-2a14-4c40-9832-892d06318f7a', 'cbdc98f4-eccf-4b0d-9773-d50ea569981d'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:11 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de" returned: 0 in 0.303s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:11 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:12 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.info Sep 08 19:21:12 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:12 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.367s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Deleted volume successfully. Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-e7b3e6a2-2506-4b38-af3d-83c7be9780fa tempest-ProjectReaderTests-1015780814 None] Lock "cinder-f27de0d2-0992-4a7a-b82c-8dfbb801faad-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:12 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.info" returned: 0 in 0.356s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:12 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.info is being set with open permissions: ugo+rw Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:12 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.info Sep 08 19:21:12 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (ecd00e95-45e0-495b-809a-b19c7f70b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37cf188-18e6-430c-ab3c-dd78c5fee6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37cf188-18e6-430c-ab3c-dd78c5fee6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65015997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9ff378-275c-4738-8969-d7820f15aa96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:12Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f10b2f-5a20-4d13-86c1-d9da761a2ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f10b2f-5a20-4d13-86c1-d9da761a2ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a3dda5-5cf3-4efb-9de2-56f2e0505dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a3dda5-5cf3-4efb-9de2-56f2e0505dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9ff378-275c-4738-8969-d7820f15aa96', 'volume_name': 'volume-bc9ff378-275c-4738-8969-d7820f15aa96', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec956c6-42ba-456d-aa2f-9da9a39f9c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec956c6-42ba-456d-aa2f-9da9a39f9c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28b1b5c-44bc-415a-b884-44b12d641dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:12 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Volume bc9ff378-275c-4738-8969-d7820f15aa96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9ff378-275c-4738-8969-d7820f15aa96', 'volume_size': 1} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:12 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.info" returned: 0 in 0.408s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65015997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9ff378-275c-4738-8969-d7820f15aa96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='015d45c060b347648986a7d19a2c1efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:12Z,use_quota=True,user_id='7f99d2012c5e42608adda31480898b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Creating volume bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:12 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:21:12 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:12 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 1073741824 Sep 08 19:21:12 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:12 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3535f1e9-1fd0-49c3-8fb3-d15719ccc5e0 tempest-ProjectMemberTests-823681440 None] Create snapshot completed successfully Sep 08 19:21:13 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 1073741824" returned: 0 in 0.483s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:13 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 Sep 08 19:21:13 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:13 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96" returned: 0 in 0.266s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28b1b5c-44bc-415a-b884-44b12d641dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9ff378-275c-4738-8969-d7820f15aa96', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b292b7-4275-424c-95cf-19b7db206156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:13 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Volume volume-bc9ff378-275c-4738-8969-d7820f15aa96 (bc9ff378-275c-4738-8969-d7820f15aa96): created successfully Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b292b7-4275-424c-95cf-19b7db206156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Flow 'volume_create_manager' (ecd00e95-45e0-495b-809a-b19c7f70b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:13 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-29e4e7e6-068d-4b04-bc87-835e8839737f tempest-ProjectReaderTests-1015780814 None] Created volume successfully. Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-346592c6-80f2-42ce-b14f-a38536e024de-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Lock "cinder-346592c6-80f2-42ce-b14f-a38536e024de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-192e3d9e-854b-41be-aa4a-26779cedf678" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-192e3d9e-854b-41be-aa4a-26779cedf678" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-346592c6-80f2-42ce-b14f-a38536e024de" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-346592c6-80f2-42ce-b14f-a38536e024de" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Deleting offline snapshot 346592c6-80f2-42ce-b14f-a38536e024de of volume 192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] snapshot_file for this snap is: volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afc8c57-2015-438a-95ff-477133eeb9ce]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:13 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:13 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de Sep 08 19:21:13 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:14 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de" returned: 0 in 0.377s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-192e3d9e-854b-41be-aa4a-26779cedf678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a7631-a17f-40f8-ba23-b478a2796c08]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:14 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 Sep 08 19:21:14 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:14 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678" returned: 0 in 0.387s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:14 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de Sep 08 19:21:14 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Creating offline snapshot 31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 of volume bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c8f76-1b53-4a5f-8fed-f61642baa8cf]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:14 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:14 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 Sep 08 19:21:14 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:15 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de" returned: 0 in 0.440s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:15 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de Sep 08 19:21:15 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:15 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96" returned: 0 in 0.438s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:15 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 1G Sep 08 19:21:15 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:15 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678.346592c6-80f2-42ce-b14f-a38536e024de" returned: 0 in 0.334s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-346592c6-80f2-42ce-b14f-a38536e024de" released by "_delete_snapshot" :: held 1.655s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-192e3d9e-854b-41be-aa4a-26779cedf678" released by "delete_snapshot" :: held 1.689s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Created reservations ['0784af96-793c-47df-88fa-517dd2aa04c9', '27cf5979-7912-4650-8fe9-b91e5407e57d', '9b5ab898-902c-4475-88d6-e9e849f0632f', '89fbda9e-de24-47ec-b5af-1b05df7316b1'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:15 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Delete snapshot completed successfully. Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-0ee7d8b9-d80a-4ed7-b01d-7001d716c584 tempest-ProjectMemberTests-823681440 None] Lock "cinder-346592c6-80f2-42ce-b14f-a38536e024de-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:15 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 1G" returned: 0 in 0.498s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9ff378-275c-4738-8969-d7820f15aa96 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:15 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9ff378-275c-4738-8969-d7820f15aa96 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 Sep 08 19:21:15 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-192e3d9e-854b-41be-aa4a-26779cedf678-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Lock "cinder-192e3d9e-854b-41be-aa4a-26779cedf678-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:15 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Acquiring lock "cinder-quobyte-192e3d9e-854b-41be-aa4a-26779cedf678" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-192e3d9e-854b-41be-aa4a-26779cedf678" acquired by "delete_volume" :: waited 0.023s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[df465851-c0ea-493d-a108-808cef84cd80]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9ff378-275c-4738-8969-d7820f15aa96 -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" returned: 0 in 0.436s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:16 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 is being set with open permissions: ugo+rw Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 Sep 08 19:21:16 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:16 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 Sep 08 19:21:16 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:16 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678" returned: 0 in 0.393s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" returned: 0 in 0.288s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:16 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678 Sep 08 19:21:16 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.info Sep 08 19:21:16 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:16 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-192e3d9e-854b-41be-aa4a-26779cedf678" returned: 0 in 0.282s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:16 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.info" returned: 0 in 0.264s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:16 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.info is being set with open permissions: ugo+rw Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Lock "cinder-quobyte-192e3d9e-854b-41be-aa4a-26779cedf678" released by "delete_volume" :: held 0.757s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:16 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.info Sep 08 19:21:16 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Created reservations ['6a4640df-71f4-41b8-a855-85c78b5396e5', 'e4167861-0a93-46ab-a7bc-3e2b1db2feb1', 'aa268326-71b8-4187-8ae4-13445da25074', '5c3328e7-6b40-4fd8-81d1-749b3eb56e62'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:16 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:17 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.info" returned: 0 in 0.340s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:17 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-def9bd06-2a66-41ce-80aa-bd5ca7b3bdd7 tempest-ProjectReaderTests-1015780814 None] Create snapshot completed successfully Sep 08 19:21:17 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.322s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:17 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Deleted volume successfully. Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-f6ab439d-98ce-4972-aae1-9afa3d71f504 tempest-ProjectMemberTests-823681440 None] Lock "cinder-192e3d9e-854b-41be-aa4a-26779cedf678-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-31683c76-9cfa-4ec9-9e7b-c0f5d3152d72-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Lock "cinder-31683c76-9cfa-4ec9-9e7b-c0f5d3152d72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:17 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-bc9ff378-275c-4738-8969-d7820f15aa96" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-bc9ff378-275c-4738-8969-d7820f15aa96" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Deleting offline snapshot 31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 of volume bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] snapshot_file for this snap is: volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[c362bec5-0e0b-48b5-988e-50a3d226cd8c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:18 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 Sep 08 19:21:18 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:18 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" returned: 0 in 0.507s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc9ff378-275c-4738-8969-d7820f15aa96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10ddd52-c0f3-4338-acec-fe900f1e452e]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:18 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:18 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 Sep 08 19:21:18 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:19 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96" returned: 0 in 0.437s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:19 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 Sep 08 19:21:19 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:19 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" returned: 0 in 0.399s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:19 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72 Sep 08 19:21:19 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=215,cinder:INSERT=83,cinder:UPDATE=281,cinder:DELETE=24 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:INSERT=73,cinder:UPDATE=279,cinder:SELECT=200,cinder:DELETE=22 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:19 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Flow 'volume_create_manager' (eb7413a6-2361-44d9-a8e9-7019853c29d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427effe7-f3d3-498b-ac02-dab9d82e76b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96.31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" returned: 0 in 0.394s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427effe7-f3d3-498b-ac02-dab9d82e76b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1285979391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bead77-ed47-44db-af41-304bd4ad22dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93a8718805b4483b4a4b91c47807651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:20Z,use_quota=True,user_id='b9bc1963c0624e4c82c6857514d6f998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72804e8-d560-4a7b-9a58-e8e29adfadbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72804e8-d560-4a7b-9a58-e8e29adfadbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baaed3e2-980c-41a0-80d9-a87a443d8003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baaed3e2-980c-41a0-80d9-a87a443d8003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bead77-ed47-44db-af41-304bd4ad22dd', 'volume_name': 'volume-97bead77-ed47-44db-af41-304bd4ad22dd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664eccf3-273c-4554-a085-b8978ea05d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664eccf3-273c-4554-a085-b8978ea05d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edea635-41fd-4ef9-8088-107a9745e323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:19 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Volume 97bead77-ed47-44db-af41-304bd4ad22dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bead77-ed47-44db-af41-304bd4ad22dd', 'volume_size': 1} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1285979391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bead77-ed47-44db-af41-304bd4ad22dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93a8718805b4483b4a4b91c47807651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:20Z,use_quota=True,user_id='b9bc1963c0624e4c82c6857514d6f998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Creating volume 97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:19 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-31683c76-9cfa-4ec9-9e7b-c0f5d3152d72" released by "_delete_snapshot" :: held 1.952s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:19 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-bc9ff378-275c-4738-8969-d7820f15aa96" released by "delete_snapshot" :: held 1.984s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:19 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd 1073741824 Sep 08 19:21:19 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Created reservations ['9cbdd5b1-339c-489b-87ac-7f0f72ef66a2', 'b62a7833-2207-4221-9c4a-84bd88001723', '7f3139aa-3c0d-446c-8801-3b3b5044bd6e', 'be72ea74-5be2-4e90-84a2-b18974f18603'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Delete snapshot completed successfully. Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-7a81dae9-2f21-432f-adf4-8b7aa81ab44a tempest-ProjectReaderTests-1015780814 None] Lock "cinder-31683c76-9cfa-4ec9-9e7b-c0f5d3152d72-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:20 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd 1073741824" returned: 0 in 0.479s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:20 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd Sep 08 19:21:20 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:20 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd" returned: 0 in 0.269s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edea635-41fd-4ef9-8088-107a9745e323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bead77-ed47-44db-af41-304bd4ad22dd', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9448b74a-41a8-4158-82c7-488d4610147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:20 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Volume volume-97bead77-ed47-44db-af41-304bd4ad22dd (97bead77-ed47-44db-af41-304bd4ad22dd): created successfully Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9448b74a-41a8-4158-82c7-488d4610147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:20 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Flow 'volume_create_manager' (eb7413a6-2361-44d9-a8e9-7019853c29d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:20 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1e02371c-1833-4027-9bdf-1d0c67ce0c02 tempest-SnapshotDependencyTests-234248401 None] Created volume successfully. Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-bc9ff378-275c-4738-8969-d7820f15aa96-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-bc9ff378-275c-4738-8969-d7820f15aa96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "cinder-quobyte-bc9ff378-275c-4738-8969-d7820f15aa96" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-bc9ff378-275c-4738-8969-d7820f15aa96" acquired by "delete_volume" :: waited 0.021s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaf6924-e1d5-401d-a518-8b9c24045a67]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:21 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 Sep 08 19:21:21 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:21 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96" returned: 0 in 0.355s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:21 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96 Sep 08 19:21:21 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:21 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-bc9ff378-275c-4738-8969-d7820f15aa96" returned: 0 in 0.250s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:21 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-quobyte-bc9ff378-275c-4738-8969-d7820f15aa96" released by "delete_volume" :: held 0.675s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Created reservations ['6fd188d7-0f74-4db0-bf10-5bd2f93ec917', '97631ce9-b946-443f-a50e-be5d2f4a0d3d', '870f4028-aac3-4813-934f-13128c433308', 'bfc9720d-d145-4901-bf7e-59dab50e9874'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:22 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:22 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Creating offline snapshot 9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 of volume 97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[159fa2eb-161b-43dc-ad9b-39829818c5ee]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Flow 'volume_create_manager' (ebb1c7d3-681e-412a-8a8f-6324b4807403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2ecc27-e4c3-4cbf-8f72-286831956b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2ecc27-e4c3-4cbf-8f72-286831956b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803964577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069839ee-c541-4b9f-a21d-9e7947217611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a872f4dea513412db5ad9bf54e2f2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:22Z,use_quota=True,user_id='4b38cde0a3824723bf66b66e83ccbf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baa052f-33ec-41bc-b597-1367730322a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baa052f-33ec-41bc-b597-1367730322a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b80d7f-aaac-4900-ae30-0aa13b2aeedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b80d7f-aaac-4900-ae30-0aa13b2aeedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069839ee-c541-4b9f-a21d-9e7947217611', 'volume_name': 'volume-069839ee-c541-4b9f-a21d-9e7947217611', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6577288e-9928-4061-b367-4d26aa92a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:22 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6577288e-9928-4061-b367-4d26aa92a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ba9470-8aad-436f-b45c-38eeeb1e0d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:22 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Volume 069839ee-c541-4b9f-a21d-9e7947217611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069839ee-c541-4b9f-a21d-9e7947217611', 'volume_size': 1} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.299s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:22 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Deleted volume successfully. Sep 08 19:21:22 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd Sep 08 19:21:22 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3f597682-35b7-496c-ba68-ddeb316c08b2 tempest-ProjectReaderTests-1015780814 None] Lock "cinder-bc9ff378-275c-4738-8969-d7820f15aa96-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:22 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd" returned: 0 in 0.381s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:22 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 1G {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:22 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 1G Sep 08 19:21:22 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:23 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 1G" returned: 0 in 0.401s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bead77-ed47-44db-af41-304bd4ad22dd -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:23 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bead77-ed47-44db-af41-304bd4ad22dd -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 Sep 08 19:21:23 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:23 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bead77-ed47-44db-af41-304bd4ad22dd -F qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" returned: 0 in 0.313s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:23 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 is being set with open permissions: ugo+rw Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:23 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 Sep 08 19:21:23 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:23 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" returned: 0 in 0.248s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:23 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.info Sep 08 19:21:23 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:23 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.info" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:23 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.info is being set with open permissions: ugo+rw Sep 08 19:21:23 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.info {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.info Sep 08 19:21:24 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.info" returned: 0 in 0.254s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.828s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803964577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069839ee-c541-4b9f-a21d-9e7947217611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a872f4dea513412db5ad9bf54e2f2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:22Z,use_quota=True,user_id='4b38cde0a3824723bf66b66e83ccbf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Creating volume 069839ee-c541-4b9f-a21d-9e7947217611 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:24 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 1073741824 Sep 08 19:21:24 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-c94cf24a-1788-4d22-9918-64b5f9533648 tempest-SnapshotDependencyTests-234248401 None] Create snapshot completed successfully Sep 08 19:21:24 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 1073741824" returned: 0 in 0.404s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 Sep 08 19:21:24 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611" returned: 0 in 0.233s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ba9470-8aad-436f-b45c-38eeeb1e0d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069839ee-c541-4b9f-a21d-9e7947217611', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9cd701-88b1-4286-9d90-886d70d3e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:24 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Volume volume-069839ee-c541-4b9f-a21d-9e7947217611 (069839ee-c541-4b9f-a21d-9e7947217611): created successfully Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9cd701-88b1-4286-9d90-886d70d3e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:24 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Flow 'volume_create_manager' (ebb1c7d3-681e-412a-8a8f-6324b4807403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:24 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-d5b94e8d-1959-443c-a835-b6e52bcfaf56 tempest-ProjectReaderTests-1293658733 None] Created volume successfully. Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Acquiring lock "cinder-069839ee-c541-4b9f-a21d-9e7947217611-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Lock "cinder-069839ee-c541-4b9f-a21d-9e7947217611-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Acquiring lock "cinder-quobyte-069839ee-c541-4b9f-a21d-9e7947217611" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Lock "cinder-quobyte-069839ee-c541-4b9f-a21d-9e7947217611" acquired by "delete_volume" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fecb35f-8432-40a4-aea1-1e73e55c274d]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Flow 'volume_create_manager' (4180461f-0363-4187-b5bc-04d36605e0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55911d0f-bb02-470b-ae4f-f572afd240b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55911d0f-bb02-470b-ae4f-f572afd240b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=230059a9-8b5e-48dc-96dd-06dafda64c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93a8718805b4483b4a4b91c47807651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:26Z,use_quota=True,user_id='b9bc1963c0624e4c82c6857514d6f998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d0f2bc-14d9-417b-a08a-6615769be1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d0f2bc-14d9-417b-a08a-6615769be1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:25 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 Sep 08 19:21:25 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5ac98c-d8b0-41b5-89a7-dec11850243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5ac98c-d8b0-41b5-89a7-dec11850243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '230059a9-8b5e-48dc-96dd-06dafda64c22', 'volume_name': 'volume-230059a9-8b5e-48dc-96dd-06dafda64c22', 'volume_size': 1, 'snapshot_id': '9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1494f-a414-419a-b17f-8116d03d3f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a1494f-a414-419a-b17f-8116d03d3f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdd5667-618f-4a31-8511-d5496c6a7e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:25 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Volume 230059a9-8b5e-48dc-96dd-06dafda64c22: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-230059a9-8b5e-48dc-96dd-06dafda64c22', 'volume_size': 1, 'snapshot_id': '9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3'} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-quobyte-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3-230059a9-8b5e-48dc-96dd-06dafda64c22" by "_create_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3-230059a9-8b5e-48dc-96dd-06dafda64c22" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Creating volume 230059a9-8b5e-48dc-96dd-06dafda64c22 from snapshot 9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-quobyte-230059a9-8b5e-48dc-96dd-06dafda64c22" by "_copy_volume_from_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-230059a9-8b5e-48dc-96dd-06dafda64c22" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] snapshot: 9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3, volume: 230059a9-8b5e-48dc-96dd-06dafda64c22, {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:25 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae77016-bead-4884-9dad-ff18a558f1dd]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 Sep 08 19:21:26 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611" returned: 0 in 0.387s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611 Sep 08 19:21:26 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" returned: 0 in 0.377s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97bead77-ed47-44db-af41-304bd4ad22dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aca8dc0-8d63-4da4-abcf-63fe5b23a189]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-069839ee-c541-4b9f-a21d-9e7947217611" returned: 0 in 0.258s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Lock "cinder-quobyte-069839ee-c541-4b9f-a21d-9e7947217611" released by "delete_volume" :: held 0.686s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Created reservations ['7548cd22-4304-4f90-bbc3-0065c361899b', 'c93ba691-d11f-4c0a-bc6e-d4b4d2a3ae14', 'a9d599e0-6ef1-4b0b-9392-5ec5b8563a78', '25eb7c8a-3d9c-40d3-a28f-6d96667684b8'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:26 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd Sep 08 19:21:26 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:26 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd" returned: 0 in 0.372s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Creating direct copy from snapshot {{(pid=87538) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.utils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Path /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 not found in is_blk_device check {{(pid=87538) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 Sep 08 19:21:26 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.272s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:26 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Deleted volume successfully. Sep 08 19:21:26 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-6aed4238-7639-4e8b-9ae0-555715fb52be tempest-ProjectReaderTests-1293658733 None] Lock "cinder-069839ee-c541-4b9f-a21d-9e7947217611-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87538) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Flow 'volume_create_manager' (08f859de-547c-41ed-9248-7888064bdc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70916d6-581b-4c38-bff7-da6ab390899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70916d6-581b-4c38-bff7-da6ab390899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-405280281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9323e8e1-b096-4057-9ca8-423b983d6f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a872f4dea513412db5ad9bf54e2f2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:27Z,use_quota=True,user_id='4b38cde0a3824723bf66b66e83ccbf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeaca25-8a7b-4da9-96dc-9ea667dc5876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeaca25-8a7b-4da9-96dc-9ea667dc5876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fb7dfe-ba5c-44f6-a436-3891209cbb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fb7dfe-ba5c-44f6-a436-3891209cbb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9323e8e1-b096-4057-9ca8-423b983d6f31', 'volume_name': 'volume-9323e8e1-b096-4057-9ca8-423b983d6f31', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4913b14-71e3-4434-8788-e51194a4e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4913b14-71e3-4434-8788-e51194a4e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325d0eab-e375-43f2-bf7d-28cc0b597ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Volume 9323e8e1-b096-4057-9ca8-423b983d6f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9323e8e1-b096-4057-9ca8-423b983d6f31', 'volume_size': 1} Sep 08 19:21:27 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:31 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22" returned: 0 in 4.252s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.image.image_utils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Image conversion details: src /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 {{(pid=87538) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:21:31 devstack cinder-volume[87538]: INFO cinder.image.image_utils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Converted 1024.00 MB image at 240.80 MB/s Sep 08 19:21:31 devstack cinder-volume[87538]: WARNING cinder.volume.drivers.remotefs [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 is being set with open permissions: ugo+rw Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:31 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 Sep 08 19:21:31 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:31 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22" returned: 0 in 0.253s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-230059a9-8b5e-48dc-96dd-06dafda64c22" released by "_copy_volume_from_snapshot" :: held 5.347s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3-230059a9-8b5e-48dc-96dd-06dafda64c22" released by "_create_volume_from_snapshot" :: held 5.407s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.422s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.757s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-405280281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9323e8e1-b096-4057-9ca8-423b983d6f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a872f4dea513412db5ad9bf54e2f2266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:27Z,use_quota=True,user_id='4b38cde0a3824723bf66b66e83ccbf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f4e85c9-faac-4845-9620-f0de7912334d),volume_type_id=3f4e85c9-faac-4845-9620-f0de7912334d)}" {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Creating volume 9323e8e1-b096-4057-9ca8-423b983d6f31 {{(pid=87538) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Selected osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a as target Quobyte volume. {{(pid=87538) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:31 devstack cinder-volume[87538]: INFO cinder.volume.drivers.remotefs [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] casted to osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 1073741824 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:31 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 1073741824 Sep 08 19:21:31 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fdd5667-618f-4a31-8511-d5496c6a7e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-230059a9-8b5e-48dc-96dd-06dafda64c22', 'volume_size': 1, 'snapshot_id': '9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3'}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680b7f78-231c-4828-b8a6-fe2e5593d05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:31 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Volume volume-230059a9-8b5e-48dc-96dd-06dafda64c22 (230059a9-8b5e-48dc-96dd-06dafda64c22): created successfully Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680b7f78-231c-4828-b8a6-fe2e5593d05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Flow 'volume_create_manager' (4180461f-0363-4187-b5bc-04d36605e0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:31 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-198cc0bd-b5bd-471a-bacf-1db3de6c75e6 tempest-SnapshotDependencyTests-234248401 None] Created volume successfully. Sep 08 19:21:31 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 1073741824" returned: 0 in 0.429s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:31 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:31 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 Sep 08 19:21:31 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:32 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31" returned: 0 in 0.243s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'} {{(pid=87538) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325d0eab-e375-43f2-bf7d-28cc0b597ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9323e8e1-b096-4057-9ca8-423b983d6f31', 'volume_size': 1}' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6734cf65-cfce-458e-a350-9bd88294c248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:32 devstack cinder-volume[87538]: INFO cinder.volume.flows.manager.create_volume [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Volume volume-9323e8e1-b096-4057-9ca8-423b983d6f31 (9323e8e1-b096-4057-9ca8-423b983d6f31): created successfully Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6734cf65-cfce-458e-a350-9bd88294c248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87538) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Flow 'volume_create_manager' (08f859de-547c-41ed-9248-7888064bdc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87538) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:32 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-b61634b8-3661-4a24-a6f2-9e9b852f98d2 tempest-ProjectReaderTests-1293658733 None] Created volume successfully. Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3-delete_snapshot" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-quobyte-97bead77-ed47-44db-af41-304bd4ad22dd" by "delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-97bead77-ed47-44db-af41-304bd4ad22dd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-quobyte-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" by "_delete_snapshot" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Deleting offline snapshot 9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 of volume 97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] snapshot_file for this snap is: volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c63712e-3556-4afe-921f-cfd6a2a4bfcc]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:32 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 Sep 08 19:21:32 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:32 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" returned: 0 in 0.345s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.remotefs [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97bead77-ed47-44db-af41-304bd4ad22dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87538) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4799dc2-fc98-435e-9061-53129f93cb61]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Acquiring lock "cinder-9323e8e1-b096-4057-9ca8-423b983d6f31-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Lock "cinder-9323e8e1-b096-4057-9ca8-423b983d6f31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Acquiring lock "cinder-quobyte-9323e8e1-b096-4057-9ca8-423b983d6f31" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:32 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd Sep 08 19:21:32 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Lock "cinder-quobyte-9323e8e1-b096-4057-9ca8-423b983d6f31" acquired by "delete_volume" :: waited 0.017s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf9e2a7-1d5a-48d9-b452-d49f70acf383]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:32 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:33 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 Sep 08 19:21:33 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:33 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd" returned: 0 in 0.547s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:33 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31" returned: 0 in 0.400s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:33 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 Sep 08 19:21:33 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:33 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31 Sep 08 19:21:33 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:33 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-9323e8e1-b096-4057-9ca8-423b983d6f31" returned: 0 in 0.249s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Lock "cinder-quobyte-9323e8e1-b096-4057-9ca8-423b983d6f31" released by "delete_volume" :: held 0.686s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Created reservations ['12b5cc68-2fef-4505-855a-b7d5a6625c16', '8903e3d5-e83f-4f2b-935d-a4ca45ceabb6', 'f9b314ba-4b86-4259-aacd-cbf80847455a', 'd027b811-03df-4fb9-b40a-56c6ca054550'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:33 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" returned: 0 in 0.350s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:33 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3 Sep 08 19:21:33 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:33 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:33 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:33 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:33 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd.9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" returned: 0 in 0.239s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3" released by "_delete_snapshot" :: held 1.608s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-97bead77-ed47-44db-af41-304bd4ad22dd" released by "delete_snapshot" :: held 1.630s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:34 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.293s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Deleted volume successfully. Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Created reservations ['351de6fd-ac15-4c8a-8f6d-ee579e9c634b', '6f07d38e-3b37-4da8-a80e-26a7716013a1', 'dc9e1a50-4bfd-4a43-9649-2a31f9a81360', 'ca104678-819d-4436-b502-04130a377755'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-3806f855-4c98-4a9f-b35d-92eacf8ca21e tempest-ProjectReaderTests-1293658733 None] Lock "cinder-9323e8e1-b096-4057-9ca8-423b983d6f31-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:34 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Delete snapshot completed successfully. Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-672a3f04-1c43-4705-8aa1-903631b78ca0 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-9da81e64-38f3-4c4b-aa1a-c17b5fd7e5f3-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:34 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:34 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-97bead77-ed47-44db-af41-304bd4ad22dd-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-97bead77-ed47-44db-af41-304bd4ad22dd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-quobyte-97bead77-ed47-44db-af41-304bd4ad22dd" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:34 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.273s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_service.periodic_task [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] Running periodic task VolumeManager._thread_info {{(pid=87538) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread count: 29 {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-05ea4825-4a4b-4f50-8b56-6e79046d15d2 None None] thread info: [<_MainThread(MainThread, started 123177635729536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87538) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-97bead77-ed47-44db-af41-304bd4ad22dd" acquired by "delete_volume" :: waited 0.031s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff19542-8273-4c41-b8fb-cab0243daab1]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:34 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:34 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd Sep 08 19:21:34 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:35 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd" returned: 0 in 0.368s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:35 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd Sep 08 19:21:35 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:35 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-97bead77-ed47-44db-af41-304bd4ad22dd" returned: 0 in 0.259s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-97bead77-ed47-44db-af41-304bd4ad22dd" released by "delete_volume" :: held 0.685s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Created reservations ['a80a2fa4-3c64-4d7f-97b1-ca31b383d1de', 'b7f54350-7e8e-44ec-b245-89fbf33f1f13', 'b3628dbd-e541-4dc2-b160-b2656445d7ed', '61eb4d54-f34a-434a-b66f-2c0d881c15fd'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:35 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:35 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-230059a9-8b5e-48dc-96dd-06dafda64c22-delete_volume" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:35 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.298s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-230059a9-8b5e-48dc-96dd-06dafda64c22-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:35 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Deleted volume successfully. Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-8f3e2ae2-24a2-45bf-b359-ad52607097a1 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-97bead77-ed47-44db-af41-304bd4ad22dd-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "cinder-quobyte-230059a9-8b5e-48dc-96dd-06dafda64c22" by "delete_volume" {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-230059a9-8b5e-48dc-96dd-06dafda64c22" acquired by "delete_volume" :: waited 0.014s {{(pid=87538) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dde32b-f351-4829-b8cf-4fa86fceee8c]: (4, 'qcow2') {{(pid=88787) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:35 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:36 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 Sep 08 19:21:36 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:36 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22" returned: 0 in 0.396s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:36 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22 Sep 08 19:21:36 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:36 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4/volume-230059a9-8b5e-48dc-96dd-06dafda64c22" returned: 0 in 0.279s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-quobyte-230059a9-8b5e-48dc-96dd-06dafda64c22" released by "delete_volume" :: held 0.725s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG cinder.quota [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Created reservations ['9de64da5-0601-4991-9dae-661fcbfffda9', 'eedb007e-cd70-44db-b1f5-797122a67d23', '97a4b000-7015-4e1d-b890-54e63b2fcf4b', '2a38b8c3-6421-4e31-82fa-27d9662a5392'] {{(pid=87538) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a': None} {{(pid=87538) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG cinder.volume.drivers.quobyte [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2e317281-b388-455a-90af-7d59bf22667a'] {{(pid=87538) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87538) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:36 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:36 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4 Sep 08 19:21:36 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:37 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:37 devstack cinder-volume[87538]: DEBUG oslo_concurrency.processutils [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c6dea014a4cf3a91b8eeb8ec8ab62bc4" returned: 0 in 0.315s {{(pid=87538) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:37 devstack cinder-volume[87538]: DEBUG cinder.manager [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Notifying Schedulers of capabilities ... {{(pid=87538) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:37 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Deleted volume successfully. Sep 08 19:21:37 devstack cinder-volume[87538]: DEBUG cinder.coordination [None req-1efca3a9-699a-4da8-8388-4c3011db3501 tempest-SnapshotDependencyTests-234248401 None] Lock "cinder-230059a9-8b5e-48dc-96dd-06dafda64c22-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87538) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:46 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=47,cinder:INSERT=21,cinder:UPDATE=63,cinder:DELETE=2 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:21:47 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=66,cinder:DELETE=8 {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}